-- Logs begin at Thu 2022-10-06 03:52:36 UTC, end at Thu 2022-10-06 04:52:59 UTC. -- Oct 06 04:17:47.142959 dv-cinder-860227-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 06 04:17:47.154875 dv-cinder-860227-2-smb devstack@keystone.service[81422]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 04:17:47 2022] *** Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: nodename: dv-cinder-860227-2-smb Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: machine: x86_64 Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: clock source: unix Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: pcre jit disabled Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: detected number of CPU cores: 4 Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: current working directory: / Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: detected binary path: /usr/bin/uwsgi-core Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: your processes number limit is 47680 Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: your memory page size is 4096 bytes Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: detected max file descriptor number: 2048 Oct 06 04:17:47.156222 dv-cinder-860227-2-smb devstack@keystone.service[81422]: lock engine: pthread robust mutexes Oct 06 04:17:47.156940 dv-cinder-860227-2-smb devstack@keystone.service[81422]: thunder lock: enabled Oct 06 04:17:47.156940 dv-cinder-860227-2-smb devstack@keystone.service[81422]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 06 04:17:47.156940 dv-cinder-860227-2-smb devstack@keystone.service[81422]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 04:17:47.195516 dv-cinder-860227-2-smb devstack@keystone.service[81422]: Python main interpreter initialized at 0x55ca812c79c0 Oct 06 04:17:47.195516 dv-cinder-860227-2-smb devstack@keystone.service[81422]: python threads support enabled Oct 06 04:17:47.195516 dv-cinder-860227-2-smb devstack@keystone.service[81422]: your server socket listen backlog is limited to 100 connections Oct 06 04:17:47.195516 dv-cinder-860227-2-smb devstack@keystone.service[81422]: your mercy for graceful operations on workers is 90 seconds Oct 06 04:17:47.195912 dv-cinder-860227-2-smb devstack@keystone.service[81422]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 04:17:47.195912 dv-cinder-860227-2-smb devstack@keystone.service[81422]: *** Operational MODE: preforking *** Oct 06 04:17:47.196212 dv-cinder-860227-2-smb devstack@keystone.service[81422]: *** uWSGI is running in multiple interpreter mode *** Oct 06 04:17:47.196212 dv-cinder-860227-2-smb devstack@keystone.service[81422]: spawned uWSGI master process (pid: 81422) Oct 06 04:17:47.196389 dv-cinder-860227-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 06 04:17:47.197594 dv-cinder-860227-2-smb devstack@keystone.service[81422]: spawned uWSGI worker 1 (pid: 81436, cores: 1) Oct 06 04:17:47.197594 dv-cinder-860227-2-smb devstack@keystone.service[81422]: spawned uWSGI worker 2 (pid: 81437, cores: 1) Oct 06 04:17:47.197594 dv-cinder-860227-2-smb devstack@keystone.service[81422]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 04:17:51.420264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:17:51.420264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: from cryptography.utils import int_from_bytes Oct 06 04:17:51.421084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:17:51.421084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: from cryptography.utils import int_from_bytes Oct 06 04:17:51.421521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:17:51.421521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: from cryptography.utils import int_from_bytes Oct 06 04:17:51.421641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:17:51.421641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: from cryptography.utils import int_from_bytes Oct 06 04:17:51.470415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 04:17:51.470617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 04:17:51.470782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] command line args: [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 04:17:51.470937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 04:17:51.471018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 04:17:51.471134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 04:17:51.471219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ================================================================================ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 04:17:51.471287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] command line args: [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 04:17:51.471445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] admin_token = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.471600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 04:17:51.471689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config_dir = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.471764 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ================================================================================ {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 04:17:51.471855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.472001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] admin_token = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.472087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config_source = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.472201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] debug = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.472276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] config_dir = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.472391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.473665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.473665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] config_source = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.473789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.473854 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] debug = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.473921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.473986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474324 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_config_append = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_dir = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_config_append = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_dir = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.474974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_file = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.475966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.476046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.476113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.476179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.476382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.476504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.476590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.476670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.476820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.476941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.477034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.477109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.477263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.477404 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.477484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.477609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.477696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.478001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.478121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.478210 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] publish_errors = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.478400 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.478519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.478598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.478679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] publish_errors = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.478764 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.478891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.478990 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.479073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.479239 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.479412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.479502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] standard_threads = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.479581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.479690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.479782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.479946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] standard_threads = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.480076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.480076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.480220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.480292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_journal = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.480361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.480487 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_json = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.480567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.480686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_stderr = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.480789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] use_journal = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.480889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_syslog = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.481005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] use_json = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.481124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.481235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] use_stderr = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.481235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] use_syslog = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.481454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.481571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:17:51.481698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.481886 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.482008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.482120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.482236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.482347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.482456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.482578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.482701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.482818 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.482929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.483044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.483157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.483278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.483411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.483534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.483653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.483653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.483867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.483984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.484094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.484203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.484318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.484427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.484543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.484663 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.484779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.484897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.485009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.485119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.485246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.485434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.485587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.485710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.485822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.485931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.485931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.486221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.486330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.486445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.486564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.486680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.486800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.486910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.487025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.487135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.487244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.487397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.487526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.487638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.487755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.487866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.487981 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.488091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.488211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.488322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.488431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.488540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.488640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.488733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.488835 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.488946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.489055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.489165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.489274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.489389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.489507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.489618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.489732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.489843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.489953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.490063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.490179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.490290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.490405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.490518 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.490628 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.490737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.490855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.490967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.491076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.491185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.491703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.491824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.492003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.492117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.492226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.492334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.492443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.492557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.492737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.492850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.492960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.493070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.493179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.493288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.493405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.493516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.493625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.493734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.493845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.493954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.494074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.494185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.494294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.494403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.494512 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.494620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.494739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.494850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.494959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.495103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.495209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.495332 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.495434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.495529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.495623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.495717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.495822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.495927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.496023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.496117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.496239 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.496357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.496460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.496578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.496689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.496810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.496929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.497041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.497143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.497259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.497370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.497487 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.497599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.497713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.497823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.497939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.498049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.498175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.498288 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.498403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.498505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.498614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.498724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.498849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.498961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.499071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.499183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.499352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.499478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.499598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.499702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.499811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.499921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.500038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.500150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.500268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.500402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.500516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.500626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.500774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.501020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.501182 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.501420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.501543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.501655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.501768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.501878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.501998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.502110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.502221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.502332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.502444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.502554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.502675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.502787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.502898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.503008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.503125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.503236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.503444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.503567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.503680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.503790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.503907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.504027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.504147 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.504271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.504389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.504500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.504612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.504723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.504833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.504951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.505063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.505174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.505285 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.505394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.505505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.505624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.505736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.505847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.505958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.506076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.506188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.506310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.506422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.506533 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.506644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.506755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.506865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.external = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.507005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.507129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.507250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.507395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.507509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.external = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.507621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.507733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.507845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.password = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.507967 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.508082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.token = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.508193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.508311 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.508424 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.password = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.508536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.508655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.token = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.508776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.508897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.509010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.509121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.509232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.509352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.509465 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.509576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.509688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.509800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.509912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.510035 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.510148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.510261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.510372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.510483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.510595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.510718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.510833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.510944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.511056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.511167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.511277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.511418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.511532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.511643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.511755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.511873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.511986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.512106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.512225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.512337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.512449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.512560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.512672 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.512791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.512904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.513018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.513129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.513241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.513352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.513473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.513592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.513704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.513881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.513997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.514108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.514228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.514341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.514452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.514564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.514676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.514795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.514909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.515028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.515140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.515252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.515378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.515511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.515625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.515737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.515855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.515969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.516082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.516201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.516328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.516444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.516617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.516715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.516826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.517014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.517131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.517242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.517354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.517466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.517577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.517697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.517810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.517930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.518043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.518156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.518267 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.518387 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.518501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.518612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.518723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.518834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.518946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.519065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.519178 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.519291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.519426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.519539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.519650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.519774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.519894 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.520007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.520118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.520230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.520343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.520462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.520576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.520690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.520802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.520913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.521025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.521145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.521258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.521377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.521490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.521602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.521718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.521838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.521951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.522063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.522160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.522270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.522383 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.522502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.522615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.522727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.522838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.522958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.523078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.523192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.523357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.523483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.523597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.523709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.523828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.523941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.524053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.524164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.524276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.524387 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.524507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.524621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.524732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.524732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.524941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.525053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.525175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.525289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.525401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.525513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.525626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.525738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.525856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.525975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.526087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.526198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.526309 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.526420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.526540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.526654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.526765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.526876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.526987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.527098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.527217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.527352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.527466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.527578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.527690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.527801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.527962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.528077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.528189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.528300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.528410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.528521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.528641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.528755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.528866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.528977 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.529088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.529199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.529319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.529432 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.529545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.529655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.529767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.529877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.529996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.530108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.530219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.530330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.530441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.530552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.530675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.530788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.530899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.531010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.531120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.531230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.531401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.531517 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.531628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.531739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.531850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.531961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.532119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.532298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.532574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.532702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.532819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.532933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.533057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.533171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.533282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.533394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.533505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.533617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.533737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.533737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.533948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.534059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.534171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.534282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.534401 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.534514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.534625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.534737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.534848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.534968 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.535088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.535201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.535326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.535440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.535552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.535664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.535788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.535901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.536014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.536125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.536237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.536348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.536468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.536581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.536692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.536803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.536915 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.537027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.537147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.537261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.537372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.537483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.537594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.537705 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.537825 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.537937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.538049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.538162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.538273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.538392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.538505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.538616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.538727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.538839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.538950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.539137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.539253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.539425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.539539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.539651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.539762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.539886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.540000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] role.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.540111 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.540224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] role.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.540336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.540448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.540568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.540681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.540797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.540909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.541021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.541133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.541254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.541368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.541480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.541592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.541704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.541816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.541940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.542053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.542165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.542277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.542389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.542501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.542621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.542735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.542847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.542958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.542958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.543168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.543287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.543418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.543418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.543628 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.543739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.543850 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.543972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.544086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.544198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.544309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.544421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.544541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.544653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.544765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.544876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.544987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.545098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.545217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.545330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.545443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.545555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.545666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.545778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.545899 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.546012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.546124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.546236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.546348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.546466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.546587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.546700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.546811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.546923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.547034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.547145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.547264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.547422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.547536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.547657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.547812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.547927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.548047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.548161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.548272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.548384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.548496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.548608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.548727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.548840 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.548951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.549062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.549173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.549284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.549403 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.549516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.549628 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.549740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.549850 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.549961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.550080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.550194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.550305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.550416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.550527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.550638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.550763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.550877 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.550997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.551118 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.551231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.551360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.551473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.551600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.551724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.551846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.551960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.552072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.552184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.connection = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.552296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.552407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.552527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.552640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.552752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.552864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.552976 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.553087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.553207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.553320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.553433 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.553545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.553657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.553769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.553890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.554003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.554114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.554226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.554337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.554449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.554568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.554681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.554792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.554905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.555016 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.555133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.555254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.555413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.555526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.555637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.555748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.555859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.555983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 04:17:51.556098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.556098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:17:51.556098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 04:17:51.583667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.583811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.583940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.584018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.584081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.584200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.592468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.592557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.620904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.621049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.621188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.621268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.674465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.674642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.723062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.723213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.723401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.723503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.883403 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.883585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.883713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.883797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.883882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.883958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.884022 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.884145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.884223 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.884295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.884370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.884511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.907770 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.907908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908649 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.908987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.909068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.920303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.920430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.932908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.933055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.933262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.933354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.933434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.933563 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.933641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.933760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.933885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.933964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.934080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.934157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.934272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.934357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 04:17:51.951013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.951149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.951287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 04:17:51.951399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 04:17:51.951552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.951665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.951780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 04:17:51.951860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 04:17:51.952039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.952163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.952324 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.952406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.952547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.952671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.952807 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.952886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.962502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.962626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.962763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.962844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.963041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.963185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.963341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.963425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.970407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:51.970531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:51.974162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:51.974415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:51.974541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.974702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.974827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.974988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.975132 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.975216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.975291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.975537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.975660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.975762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.975842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.976065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.976188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.976307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.976410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.976602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.976725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.976860 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.976979 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:51.977095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.000034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.000160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.001535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.001661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.001797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.001895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.006454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.006580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.006715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.006832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.006981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.007100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.013319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.013444 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.013564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.013759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.019466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.019618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.019762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.019868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.019996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.020163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.020334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.020429 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.020606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.020776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.020925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.021010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.021156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.021283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.021396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.021487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.036910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.037142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.037269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.037392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.041028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.041271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.044277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.044534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.044661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.044799 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.048949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.049077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.052198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.052328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.055444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.055592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.055732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.055815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.056023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.056151 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.056305 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.056389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.056582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.056710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.056848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.056944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.072704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.072888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.072977 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.073202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.073329 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.073485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.073569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.073720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.080366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.080825 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.081902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.082355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.083447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.083731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.083894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.084202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.086425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.086709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.086904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.087030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.087171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.087266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.087504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.087637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.087796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.088164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.098759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.099043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.099347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.099471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.099609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.099755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.099995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.100121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.100259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.100342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.100579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.100719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.100977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.101243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.115966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.117284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.119219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.120199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.122121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.123070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.123725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.124620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.125337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.125622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.126056 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.126458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.126458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.126870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.132448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.133255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.133951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.134702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.136815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.137210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.137497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.137623 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.137761 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.137995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.138263 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.138565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.145590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.145877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.146157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.146301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.146627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.146912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.153055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.153338 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.153620 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.153746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 04:17:52.153885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.154012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.154139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.154290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.154494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.154621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.154759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.154841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.154975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.155069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.155231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.155344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.155562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.155690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.155846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.155974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.156095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.156239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.156392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.156520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.156640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.156744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.156965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.157581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 04:17:52.190813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ca812c79c0 pid: 81436 (default app) Oct 06 04:17:52.191528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ca812c79c0 pid: 81437 (default app) Oct 06 04:17:52.194139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5a06b-c348-407e-a1c9-fb01b3d8b566 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:17:52.194423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5a06b-c348-407e-a1c9-fb01b3d8b566 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:17:52.194695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5a06b-c348-407e-a1c9-fb01b3d8b566 None None] PATH_INFO: `/v3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:17:52.199029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Thu Oct 6 04:17:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:17:59.021609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d8ad-d2a6-4c42-bbd2-23bf1c89e5f8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:17:59.022190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d8ad-d2a6-4c42-bbd2-23bf1c89e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:17:59.022190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d8ad-d2a6-4c42-bbd2-23bf1c89e5f8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:17:59.029265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:17:59 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:17:59.038236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:17:59.039083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:17:59.039083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:17:59.119146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: INFO dbcounter [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] Registered counter for database keystone Oct 06 04:17:59.141548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG oslo_db.sqlalchemy.engines [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:17:59.153508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writer thread running {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:17:59.335738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG passlib.handlers.bcrypt [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81436) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 06 04:17:59.336119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG passlib.handlers.bcrypt [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81436) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 06 04:17:59.395547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:17:59.397142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:17:59.534635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:17:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 06 04:18:00.062687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d8ad-d2a6-4c42-bbd2-23bf1c89e5f8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:00.133316 dv-cinder-860227-2-smb devstack@keystone.service[81437]: INFO dbcounter [None req-75a1d8ad-d2a6-4c42-bbd2-23bf1c89e5f8 None None] Registered counter for database keystone Oct 06 04:18:00.158389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG oslo_db.sqlalchemy.engines [None req-75a1d8ad-d2a6-4c42-bbd2-23bf1c89e5f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:18:00.166441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writer thread running {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:18:00.296402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d8ad-d2a6-4c42-bbd2-23bf1c89e5f8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:00.301873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7976f-07d4-475a-852e-861092ccae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:00.302516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7976f-07d4-475a-852e-861092ccae13 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:00.302790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7976f-07d4-475a-852e-861092ccae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:00.303057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7976f-07d4-475a-852e-861092ccae13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:00.312790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7976f-07d4-475a-852e-861092ccae13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:00.370482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: WARNING keystone.common.rbac_enforcer.enforcer [None req-51a7976f-07d4-475a-852e-861092ccae13 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 06 04:18:00.370815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7976f-07d4-475a-852e-861092ccae13 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:00.381511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Oct 6 04:18:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:18:00.388870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:00.412413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8002c4-90df-42da-b3b1-06a0e92ceee0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:00.418018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e5e1d-4a66-4521-8d63-b6303636629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:00.419121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e5e1d-4a66-4521-8d63-b6303636629d admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:00.419423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e5e1d-4a66-4521-8d63-b6303636629d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:00.419694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e5e1d-4a66-4521-8d63-b6303636629d admin admin] PATH_INFO: `/v3/projects/8fb2ccd61eb54f9ca99cf78861f2f327` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:00.421379 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e5e1d-4a66-4521-8d63-b6303636629d admin admin] RBAC: Authorizing `identity:get_project(project_id=8fb2ccd61eb54f9ca99cf78861f2f327)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:00.473975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WARNING keystone.common.rbac_enforcer.enforcer [None req-588e5e1d-4a66-4521-8d63-b6303636629d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 06 04:18:00.474331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e5e1d-4a66-4521-8d63-b6303636629d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:00.478896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Oct 6 04:18:00 2022] GET /identity/v3/projects/8fb2ccd61eb54f9ca99cf78861f2f327 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:02.594491 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc8c9-ff8a-422d-bf65-8c71d55c4cd3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:02.595023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc8c9-ff8a-422d-bf65-8c71d55c4cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:02.595023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc8c9-ff8a-422d-bf65-8c71d55c4cd3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:02.599147 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:02.606011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3cf3f-c424-4635-a149-8dc97182bf62 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:02.606709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3cf3f-c424-4635-a149-8dc97182bf62 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:02.606865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3cf3f-c424-4635-a149-8dc97182bf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:02.635448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6ff3cf3f-c424-4635-a149-8dc97182bf62 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:02.636969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6ff3cf3f-c424-4635-a149-8dc97182bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:02.645688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 06 04:18:02.907662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc8c9-ff8a-422d-bf65-8c71d55c4cd3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:02.922105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc8c9-ff8a-422d-bf65-8c71d55c4cd3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:02.927706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2714e-73ce-42de-b00a-2fd49f5c2137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:02.928314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2714e-73ce-42de-b00a-2fd49f5c2137 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:02.928595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2714e-73ce-42de-b00a-2fd49f5c2137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:02.928868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2714e-73ce-42de-b00a-2fd49f5c2137 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:02.937309 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2714e-73ce-42de-b00a-2fd49f5c2137 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:02.939175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2714e-73ce-42de-b00a-2fd49f5c2137 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:02.947974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Oct 6 04:18:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:18:02.954033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3cf3f-c424-4635-a149-8dc97182bf62 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:02.963901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3cf3f-c424-4635-a149-8dc97182bf62 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:02.969573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39256ce5-48aa-4b79-bb07-f4cbad04e094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:02.970216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39256ce5-48aa-4b79-bb07-f4cbad04e094 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:02.970493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39256ce5-48aa-4b79-bb07-f4cbad04e094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:02.970760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39256ce5-48aa-4b79-bb07-f4cbad04e094 admin admin] PATH_INFO: `/v3/users/a648d0c15aec4e95a5b091741686db89` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:02.972220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39256ce5-48aa-4b79-bb07-f4cbad04e094 admin admin] RBAC: Authorizing `identity:get_user(user_id=a648d0c15aec4e95a5b091741686db89)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:02.974064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39256ce5-48aa-4b79-bb07-f4cbad04e094 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:02.975632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Thu Oct 6 04:18:02 2022] GET /identity/v3/users/a648d0c15aec4e95a5b091741686db89 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:05.219672 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc66b4-deb4-4238-837e-2b02be38f311 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:05.220290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc66b4-deb4-4238-837e-2b02be38f311 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:05.220290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc66b4-deb4-4238-837e-2b02be38f311 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:05.221650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:05.227568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51636e96-bdb4-4c50-942a-88a6172c72f3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:05.228230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51636e96-bdb4-4c50-942a-88a6172c72f3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:05.228230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51636e96-bdb4-4c50-942a-88a6172c72f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:05.229504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72152f63-861d-4bb1-b534-f7f9f339e0cf None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:05.229791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72152f63-861d-4bb1-b534-f7f9f339e0cf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:05.230066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72152f63-861d-4bb1-b534-f7f9f339e0cf None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:05.231351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:05.236450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb2949-5e10-46d5-98e6-c61198732d6b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:05.236740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb2949-5e10-46d5-98e6-c61198732d6b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:05.237011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb2949-5e10-46d5-98e6-c61198732d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:05.248476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-51636e96-bdb4-4c50-942a-88a6172c72f3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:05.249670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-51636e96-bdb4-4c50-942a-88a6172c72f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:05.278923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG passlib.handlers.bcrypt [None req-40eb2949-5e10-46d5-98e6-c61198732d6b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81437) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 06 04:18:05.279338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG passlib.handlers.bcrypt [None req-40eb2949-5e10-46d5-98e6-c61198732d6b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81437) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 06 04:18:05.327792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-40eb2949-5e10-46d5-98e6-c61198732d6b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:05.329405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-40eb2949-5e10-46d5-98e6-c61198732d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:05.336316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:05.430227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:05.600569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51636e96-bdb4-4c50-942a-88a6172c72f3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:05.627224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:05.702090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb2949-5e10-46d5-98e6-c61198732d6b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:05.709112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51636e96-bdb4-4c50-942a-88a6172c72f3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:05.743916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc0dc4-e039-41a7-a45c-159f1ce85996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:05.744510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc0dc4-e039-41a7-a45c-159f1ce85996 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:05.744799 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc0dc4-e039-41a7-a45c-159f1ce85996 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:05.745065 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc0dc4-e039-41a7-a45c-159f1ce85996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:05.804485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb2949-5e10-46d5-98e6-c61198732d6b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:05.806973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:05.812268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc0dc4-e039-41a7-a45c-159f1ce85996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:05.813757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc0dc4-e039-41a7-a45c-159f1ce85996 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:05.836561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:05.842019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c4465-8472-417f-b052-9c1af348b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:05.843379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c4465-8472-417f-b052-9c1af348b871 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:05.843666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c4465-8472-417f-b052-9c1af348b871 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:05.843944 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c4465-8472-417f-b052-9c1af348b871 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:05.855731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c4465-8472-417f-b052-9c1af348b871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-611c4465-8472-417f-b052-9c1af348b871 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:05.864330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:05.865315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:05.866150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 8/14] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:05.871666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c4465-8472-417f-b052-9c1af348b871 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:05.913691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:05.919247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc0dc4-e039-41a7-a45c-159f1ce85996 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:05.972833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c4465-8472-417f-b052-9c1af348b871 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:06.005474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7935-5632-46b7-a57f-fa9f41ec8b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:06.006089 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7935-5632-46b7-a57f-fa9f41ec8b3e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:06.006369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7935-5632-46b7-a57f-fa9f41ec8b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:06.006639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7935-5632-46b7-a57f-fa9f41ec8b3e None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:06.007332 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7935-5632-46b7-a57f-fa9f41ec8b3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:06.007620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7935-5632-46b7-a57f-fa9f41ec8b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:06.009068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7935-5632-46b7-a57f-fa9f41ec8b3e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:06.013169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc0dc4-e039-41a7-a45c-159f1ce85996 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:06.021239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 9/16] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:06.026953 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7935-5632-46b7-a57f-fa9f41ec8b3e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:06.036045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:06.048790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2455e51-0a8d-4bed-a4aa-78efbe9ab401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:06.049435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455e51-0a8d-4bed-a4aa-78efbe9ab401 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:06.049713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455e51-0a8d-4bed-a4aa-78efbe9ab401 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:06.050006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455e51-0a8d-4bed-a4aa-78efbe9ab401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:06.054110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:06.060263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2455e51-0a8d-4bed-a4aa-78efbe9ab401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:06.061817 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2455e51-0a8d-4bed-a4aa-78efbe9ab401 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d2455e51-0a8d-4bed-a4aa-78efbe9ab401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:18:06.083167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:06.084253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:18:06.086165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:18:06.086165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:18:06.086165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:06.086165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 8/17] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:06.090187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2455e51-0a8d-4bed-a4aa-78efbe9ab401 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:06.128454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7935-5632-46b7-a57f-fa9f41ec8b3e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:06.160866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9676f54-c84b-49cc-842c-be24ffbc63ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:06.161508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9676f54-c84b-49cc-842c-be24ffbc63ed None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:06.161785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9676f54-c84b-49cc-842c-be24ffbc63ed None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:06.162081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9676f54-c84b-49cc-842c-be24ffbc63ed None admin] PATH_INFO: `/v3/users/a648d0c15aec4e95a5b091741686db89` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:06.163576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9676f54-c84b-49cc-842c-be24ffbc63ed None admin] RBAC: Authorizing `identity:get_user(user_id=a648d0c15aec4e95a5b091741686db89)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:06.165037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9676f54-c84b-49cc-842c-be24ffbc63ed None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:06.166616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:06 2022] GET /identity/v3/users/a648d0c15aec4e95a5b091741686db89 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:06.172250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9676f54-c84b-49cc-842c-be24ffbc63ed None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:06.193578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2455e51-0a8d-4bed-a4aa-78efbe9ab401 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:06.227963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b650-dd69-476d-9082-27732de00c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:06.228589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b650-dd69-476d-9082-27732de00c2d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:06.228832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b650-dd69-476d-9082-27732de00c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:06.229104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b650-dd69-476d-9082-27732de00c2d None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:06.229758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16b650-dd69-476d-9082-27732de00c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:06.230045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16b650-dd69-476d-9082-27732de00c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:06.231500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16b650-dd69-476d-9082-27732de00c2d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:06.249558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:06.265712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:06.274074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9676f54-c84b-49cc-842c-be24ffbc63ed None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:06.315266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5a4bf-6401-4aea-a487-42823487a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:06.316010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5a4bf-6401-4aea-a487-42823487a311 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:06.316347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5a4bf-6401-4aea-a487-42823487a311 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:06.316533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5a4bf-6401-4aea-a487-42823487a311 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:06.317878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5a4bf-6401-4aea-a487-42823487a311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:06.319409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5a4bf-6401-4aea-a487-42823487a311 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:06.321025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:06.327421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b650-dd69-476d-9082-27732de00c2d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:06.371462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:06.444248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b650-dd69-476d-9082-27732de00c2d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:06.479412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10526737-d6e2-4cad-a222-87c6706e9cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:06.480033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526737-d6e2-4cad-a222-87c6706e9cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:06.480322 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526737-d6e2-4cad-a222-87c6706e9cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:06.480588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526737-d6e2-4cad-a222-87c6706e9cd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:06.481319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10526737-d6e2-4cad-a222-87c6706e9cd2 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.domain.id=default, user.id=a648d0c15aec4e95a5b091741686db89) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:06.481626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10526737-d6e2-4cad-a222-87c6706e9cd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:06.483089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10526737-d6e2-4cad-a222-87c6706e9cd2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:06.492290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Oct 6 04:18:06 2022] GET /identity/v3/role_assignments?user.id=a648d0c15aec4e95a5b091741686db89&scope.domain.id=default&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:08.836402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d3da0-1ed5-4822-bcfb-bbdb4f9a7da3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:08.836927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d3da0-1ed5-4822-bcfb-bbdb4f9a7da3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:08.836927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d3da0-1ed5-4822-bcfb-bbdb4f9a7da3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:08.838537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:08.844344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037f34-9071-46a1-bb4f-0dc59ab9286f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:08.844877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037f34-9071-46a1-bb4f-0dc59ab9286f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:08.844877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037f34-9071-46a1-bb4f-0dc59ab9286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:08.872667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7e037f34-9071-46a1-bb4f-0dc59ab9286f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:08.873859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7e037f34-9071-46a1-bb4f-0dc59ab9286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:08.957449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:08.974152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41aa69-0389-4a95-b7eb-28ca61402ec8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:08.974434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41aa69-0389-4a95-b7eb-28ca61402ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:08.974716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41aa69-0389-4a95-b7eb-28ca61402ec8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:08.976078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:08.981545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67044-7620-402d-a669-2121de2c41a6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:08.981832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67044-7620-402d-a669-2121de2c41a6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:08.982107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67044-7620-402d-a669-2121de2c41a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:09.004346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-00d67044-7620-402d-a669-2121de2c41a6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:09.005859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-00d67044-7620-402d-a669-2121de2c41a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:09.033766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:09.093690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:09.269380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a395868-f86b-4d42-9ea0-6721b542022e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:09.270028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a395868-f86b-4d42-9ea0-6721b542022e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:09.270509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a395868-f86b-4d42-9ea0-6721b542022e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:09.272319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 14/26] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:09.277514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bca9a-9baa-4dfb-83fa-8d626a83ad47 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:09.277807 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bca9a-9baa-4dfb-83fa-8d626a83ad47 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:09.278080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bca9a-9baa-4dfb-83fa-8d626a83ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:09.309376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3c3bca9a-9baa-4dfb-83fa-8d626a83ad47 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:09.310609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3c3bca9a-9baa-4dfb-83fa-8d626a83ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:09.391975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a395868-f86b-4d42-9ea0-6721b542022e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:09.401334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:09.534293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bca9a-9baa-4dfb-83fa-8d626a83ad47 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:09.539671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a395868-f86b-4d42-9ea0-6721b542022e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:09.611444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10985b-c406-44eb-86f3-d5dfcdd4eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:09.612580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10985b-c406-44eb-86f3-d5dfcdd4eb78 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:09.613062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10985b-c406-44eb-86f3-d5dfcdd4eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:09.613525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10985b-c406-44eb-86f3-d5dfcdd4eb78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:09.647823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10985b-c406-44eb-86f3-d5dfcdd4eb78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:09.649694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10985b-c406-44eb-86f3-d5dfcdd4eb78 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ac10985b-c406-44eb-86f3-d5dfcdd4eb78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:18:09.681787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:09.682689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:18:09.687983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:18:09.687983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:18:09.687983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:09.689765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 15/28] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:09.694701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:09.700491 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10985b-c406-44eb-86f3-d5dfcdd4eb78 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:09.718168 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bca9a-9baa-4dfb-83fa-8d626a83ad47 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:09.735279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:09.778665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562bcf1-9ecd-49b8-85bf-33b23844bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:09.780016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562bcf1-9ecd-49b8-85bf-33b23844bdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:09.780722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562bcf1-9ecd-49b8-85bf-33b23844bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:09.781152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562bcf1-9ecd-49b8-85bf-33b23844bdc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:09.796645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562bcf1-9ecd-49b8-85bf-33b23844bdc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6562bcf1-9ecd-49b8-85bf-33b23844bdc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:09.805762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:09.806865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:09.807820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:09.810473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 14/29] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:09.816383 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35ad9-4a19-4599-991c-c52955bbe594 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:09.816383 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35ad9-4a19-4599-991c-c52955bbe594 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:09.818130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35ad9-4a19-4599-991c-c52955bbe594 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:09.819526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:09.820302 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35ad9-4a19-4599-991c-c52955bbe594 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:09.843125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10985b-c406-44eb-86f3-d5dfcdd4eb78 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:09.884798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839073be-4380-47ff-a2cf-a258399fad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:09.885774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839073be-4380-47ff-a2cf-a258399fad6a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:09.886277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839073be-4380-47ff-a2cf-a258399fad6a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:09.886780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839073be-4380-47ff-a2cf-a258399fad6a None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:09.887790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839073be-4380-47ff-a2cf-a258399fad6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:09.888296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839073be-4380-47ff-a2cf-a258399fad6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:09.890434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839073be-4380-47ff-a2cf-a258399fad6a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:09.912839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 16/31] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:09.914063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839073be-4380-47ff-a2cf-a258399fad6a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:09.932650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35ad9-4a19-4599-991c-c52955bbe594 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:09.967673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880fb78-23c8-4623-bca7-02868cd9739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:09.968505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880fb78-23c8-4623-bca7-02868cd9739c None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:09.968948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880fb78-23c8-4623-bca7-02868cd9739c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:09.969364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880fb78-23c8-4623-bca7-02868cd9739c None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:09.970241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880fb78-23c8-4623-bca7-02868cd9739c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:09.971871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880fb78-23c8-4623-bca7-02868cd9739c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:10.002154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:10.029369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839073be-4380-47ff-a2cf-a258399fad6a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:10.065038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc82ef0-678d-46a5-bbac-32623f9d4ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:10.066244 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82ef0-678d-46a5-bbac-32623f9d4ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.066664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82ef0-678d-46a5-bbac-32623f9d4ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.067083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82ef0-678d-46a5-bbac-32623f9d4ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.068071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc82ef0-678d-46a5-bbac-32623f9d4ae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:10.068587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc82ef0-678d-46a5-bbac-32623f9d4ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:10.070176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc82ef0-678d-46a5-bbac-32623f9d4ae7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:10.081330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 17/32] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:10.086864 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8f122-5a8b-458a-ab44-f4e1a81ba18d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.087350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8f122-5a8b-458a-ab44-f4e1a81ba18d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.087796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8f122-5a8b-458a-ab44-f4e1a81ba18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.108452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e4e8f122-5a8b-458a-ab44-f4e1a81ba18d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:10.109374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 16/33] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Oct 6 04:18:09 2022] POST /identity/v3/roles => generated 219 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:10.110114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e4e8f122-5a8b-458a-ab44-f4e1a81ba18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:10.110580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880fb78-23c8-4623-bca7-02868cd9739c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:10.126261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:10.194834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 18/34] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:10.199360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8f122-5a8b-458a-ab44-f4e1a81ba18d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:10.270161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:10.311108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8f122-5a8b-458a-ab44-f4e1a81ba18d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:10.351146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803bb9f-2ddd-417e-b0c8-86d51f51486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:10.351862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803bb9f-2ddd-417e-b0c8-86d51f51486a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.352140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803bb9f-2ddd-417e-b0c8-86d51f51486a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.352412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803bb9f-2ddd-417e-b0c8-86d51f51486a None admin] PATH_INFO: `/v3/users/a648d0c15aec4e95a5b091741686db89` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.353647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803bb9f-2ddd-417e-b0c8-86d51f51486a None admin] RBAC: Authorizing `identity:get_user(user_id=a648d0c15aec4e95a5b091741686db89)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:10.355157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803bb9f-2ddd-417e-b0c8-86d51f51486a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:10.361270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 19/35] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:10 2022] GET /identity/v3/users/a648d0c15aec4e95a5b091741686db89 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:10.361270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50032-bb50-4ca8-a8bb-f96681022d31 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.361270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50032-bb50-4ca8-a8bb-f96681022d31 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.361270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50032-bb50-4ca8-a8bb-f96681022d31 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.361270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 20/36] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:10.365287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa50032-bb50-4ca8-a8bb-f96681022d31 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:10.435009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880fb78-23c8-4623-bca7-02868cd9739c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:10.472623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f3511-a4f6-49b0-aded-ddc1b7fad4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:10.473689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f3511-a4f6-49b0-aded-ddc1b7fad4c2 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.474187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f3511-a4f6-49b0-aded-ddc1b7fad4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.474650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f3511-a4f6-49b0-aded-ddc1b7fad4c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.475528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f3511-a4f6-49b0-aded-ddc1b7fad4c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:10.477326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa50032-bb50-4ca8-a8bb-f96681022d31 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:10.477653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f3511-a4f6-49b0-aded-ddc1b7fad4c2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:10.513910 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 17/37] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:18:10 2022] POST /identity/v3/projects => generated 301 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:10.514917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f8ea9-bf21-4c7b-9193-f6c45a479e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:10.515675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f8ea9-bf21-4c7b-9193-f6c45a479e81 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.515980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f8ea9-bf21-4c7b-9193-f6c45a479e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.516254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f8ea9-bf21-4c7b-9193-f6c45a479e81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.516796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b56bd-436d-4693-adb1-d2f2e65da1dc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.517389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b56bd-436d-4693-adb1-d2f2e65da1dc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.517501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f8ea9-bf21-4c7b-9193-f6c45a479e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:10.518050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b56bd-436d-4693-adb1-d2f2e65da1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.519362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f8ea9-bf21-4c7b-9193-f6c45a479e81 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:10.521166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 21/38] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:10.527911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f8ea9-bf21-4c7b-9193-f6c45a479e81 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:10.530708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:10.542106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6d1b56bd-436d-4693-adb1-d2f2e65da1dc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:10.544344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6d1b56bd-436d-4693-adb1-d2f2e65da1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:10.614213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:10.629167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 18/39] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:10.670126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f8ea9-bf21-4c7b-9193-f6c45a479e81 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:10.720176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b56bd-436d-4693-adb1-d2f2e65da1dc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:10.720715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8823a-03b1-472f-90fa-0a4a3c031ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:10.721412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8823a-03b1-472f-90fa-0a4a3c031ce8 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.721686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8823a-03b1-472f-90fa-0a4a3c031ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.721961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8823a-03b1-472f-90fa-0a4a3c031ce8 None admin] PATH_INFO: `/v3/domains/default/users/a648d0c15aec4e95a5b091741686db89/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.724130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8823a-03b1-472f-90fa-0a4a3c031ce8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a648d0c15aec4e95a5b091741686db89, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:10.725518 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8823a-03b1-472f-90fa-0a4a3c031ce8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:10.852833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 22/40] 10.222.0.20 () {58 vars in 1361 bytes} [Thu Oct 6 04:18:10 2022] PUT /identity/v3/domains/default/users/a648d0c15aec4e95a5b091741686db89/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:18:10.854769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c541cb-5361-4f9b-910d-04e47d9b3e04 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.855061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c541cb-5361-4f9b-910d-04e47d9b3e04 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.855370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c541cb-5361-4f9b-910d-04e47d9b3e04 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.860021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 23/41] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:10.862730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b56bd-436d-4693-adb1-d2f2e65da1dc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:10.866182 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017eb7a-d95e-49ca-a442-cd6a93923ba6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.866836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017eb7a-d95e-49ca-a442-cd6a93923ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.867111 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017eb7a-d95e-49ca-a442-cd6a93923ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.887451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5017eb7a-d95e-49ca-a442-cd6a93923ba6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:10.889017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5017eb7a-d95e-49ca-a442-cd6a93923ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:10.908841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b2a65-1811-41c2-9c9a-c2c033e07658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:10.909914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b2a65-1811-41c2-9c9a-c2c033e07658 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:10.910386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b2a65-1811-41c2-9c9a-c2c033e07658 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:10.910848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b2a65-1811-41c2-9c9a-c2c033e07658 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:10.911862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b2a65-1811-41c2-9c9a-c2c033e07658 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:10.913713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b2a65-1811-41c2-9c9a-c2c033e07658 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:10.934570 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 19/42] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Oct 6 04:18:10 2022] POST /identity/v3/roles => generated 225 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:18:10.936550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b2a65-1811-41c2-9c9a-c2c033e07658 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:10.957083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:10.970263 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 24/43] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:11.011826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:11.071350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b2a65-1811-41c2-9c9a-c2c033e07658 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:11.115343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025464e3-ae4e-4b4a-b439-8c3b21d1b933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:11.115994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025464e3-ae4e-4b4a-b439-8c3b21d1b933 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:11.116639 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025464e3-ae4e-4b4a-b439-8c3b21d1b933 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:11.116968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025464e3-ae4e-4b4a-b439-8c3b21d1b933 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:11.117669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025464e3-ae4e-4b4a-b439-8c3b21d1b933 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:11.119094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025464e3-ae4e-4b4a-b439-8c3b21d1b933 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:11.136813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 20/44] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Oct 6 04:18:10 2022] POST /identity/v3/roles => generated 223 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:11.257906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017eb7a-d95e-49ca-a442-cd6a93923ba6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:11.376587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017eb7a-d95e-49ca-a442-cd6a93923ba6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:11.410253 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd60e2a-5d14-4e7b-a39e-c99d7c1b9752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:11.410933 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60e2a-5d14-4e7b-a39e-c99d7c1b9752 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:11.411215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60e2a-5d14-4e7b-a39e-c99d7c1b9752 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:11.411520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60e2a-5d14-4e7b-a39e-c99d7c1b9752 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:11.412670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd60e2a-5d14-4e7b-a39e-c99d7c1b9752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:11.414266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd60e2a-5d14-4e7b-a39e-c99d7c1b9752 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:11.415832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 25/45] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:11.421577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025464e3-ae4e-4b4a-b439-8c3b21d1b933 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:11.521848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025464e3-ae4e-4b4a-b439-8c3b21d1b933 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:11.532114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:11.557058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297c41-a144-46a2-9e00-e8772256a9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:11.557676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297c41-a144-46a2-9e00-e8772256a9a2 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:11.557955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297c41-a144-46a2-9e00-e8772256a9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:11.558225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297c41-a144-46a2-9e00-e8772256a9a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:11.558881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297c41-a144-46a2-9e00-e8772256a9a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:11.560365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297c41-a144-46a2-9e00-e8772256a9a2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:11.587516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 21/46] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:18:11 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:13.065116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b45f-18f1-4bc6-bb07-4dd9d97da03c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:13.065700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b45f-18f1-4bc6-bb07-4dd9d97da03c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:13.065700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b45f-18f1-4bc6-bb07-4dd9d97da03c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:13.067006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 26/47] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:13.074960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca82e-c49b-466c-bed4-2b1c611f4fcd None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:13.075394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca82e-c49b-466c-bed4-2b1c611f4fcd None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:13.075500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca82e-c49b-466c-bed4-2b1c611f4fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:13.093452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8c4ca82e-c49b-466c-bed4-2b1c611f4fcd None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:13.094630 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8c4ca82e-c49b-466c-bed4-2b1c611f4fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:13.160773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 22/48] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:13.425334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59b45f-18f1-4bc6-bb07-4dd9d97da03c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:13.492093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:13.533849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59b45f-18f1-4bc6-bb07-4dd9d97da03c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:13.567104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ec532-fa36-4c74-bd32-e5280cba54bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:13.567691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ec532-fa36-4c74-bd32-e5280cba54bd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:13.567970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ec532-fa36-4c74-bd32-e5280cba54bd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:13.568242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ec532-fa36-4c74-bd32-e5280cba54bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:13.578329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ec532-fa36-4c74-bd32-e5280cba54bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a64ec532-fa36-4c74-bd32-e5280cba54bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:13.583250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:13.584109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:13.584882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 27/49] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:13.590415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ca82e-c49b-466c-bed4-2b1c611f4fcd None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:13.687890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:13.698492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ca82e-c49b-466c-bed4-2b1c611f4fcd None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:13.735652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58ae7-a6c0-411d-b296-5e190169cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:13.736307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58ae7-a6c0-411d-b296-5e190169cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:13.736579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58ae7-a6c0-411d-b296-5e190169cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:13.736846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58ae7-a6c0-411d-b296-5e190169cfe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:13.737555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c58ae7-a6c0-411d-b296-5e190169cfe9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:13.737851 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c58ae7-a6c0-411d-b296-5e190169cfe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:13.739239 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c58ae7-a6c0-411d-b296-5e190169cfe9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:13.742417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65294ad-a1d7-4567-81a6-a3a511070e0d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:13.742730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65294ad-a1d7-4567-81a6-a3a511070e0d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:13.743000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65294ad-a1d7-4567-81a6-a3a511070e0d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:13.744393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 28/50] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:13.749318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a880f-fbb5-4acf-b1c7-6989a3557f8e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:13.749992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a880f-fbb5-4acf-b1c7-6989a3557f8e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:13.749992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a880f-fbb5-4acf-b1c7-6989a3557f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:13.753556 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 23/51] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:13.759130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58ae7-a6c0-411d-b296-5e190169cfe9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:13.770040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aa3a880f-fbb5-4acf-b1c7-6989a3557f8e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:13.771240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aa3a880f-fbb5-4acf-b1c7-6989a3557f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:13.840628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 29/52] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:13.853697 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58ae7-a6c0-411d-b296-5e190169cfe9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:13.888575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e37f58-1a21-4a7e-9726-e00e8b19cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:13.889209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37f58-1a21-4a7e-9726-e00e8b19cd68 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:13.889484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37f58-1a21-4a7e-9726-e00e8b19cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:13.889749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37f58-1a21-4a7e-9726-e00e8b19cd68 None admin] PATH_INFO: `/v3/users/a648d0c15aec4e95a5b091741686db89` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:13.890924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e37f58-1a21-4a7e-9726-e00e8b19cd68 None admin] RBAC: Authorizing `identity:get_user(user_id=a648d0c15aec4e95a5b091741686db89)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:13.892437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e37f58-1a21-4a7e-9726-e00e8b19cd68 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:13.893979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 24/53] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:13 2022] GET /identity/v3/users/a648d0c15aec4e95a5b091741686db89 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:13.899493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a880f-fbb5-4acf-b1c7-6989a3557f8e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:13.950999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:13.999793 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a880f-fbb5-4acf-b1c7-6989a3557f8e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:14.033920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5425f-2c8e-472a-8320-c00c28af7a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:14.034547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5425f-2c8e-472a-8320-c00c28af7a96 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:14.034820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5425f-2c8e-472a-8320-c00c28af7a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:14.035088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5425f-2c8e-472a-8320-c00c28af7a96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:14.036257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5425f-2c8e-472a-8320-c00c28af7a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:14.037695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5425f-2c8e-472a-8320-c00c28af7a96 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:14.039243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 30/54] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:14.045160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e37f58-1a21-4a7e-9726-e00e8b19cd68 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:14.070024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:14.109271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5425f-2c8e-472a-8320-c00c28af7a96 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:14.146721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e37f58-1a21-4a7e-9726-e00e8b19cd68 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:14.180392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d74d-8f10-4ffb-952c-645fe402b668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:14.181002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d74d-8f10-4ffb-952c-645fe402b668 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:14.181282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d74d-8f10-4ffb-952c-645fe402b668 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:14.181556 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d74d-8f10-4ffb-952c-645fe402b668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:14.182285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282d74d-8f10-4ffb-952c-645fe402b668 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.domain.id=default, user.id=a648d0c15aec4e95a5b091741686db89) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:14.182585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282d74d-8f10-4ffb-952c-645fe402b668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:14.184067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282d74d-8f10-4ffb-952c-645fe402b668 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:14.190024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 25/55] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Oct 6 04:18:14 2022] GET /identity/v3/role_assignments?user.id=a648d0c15aec4e95a5b091741686db89&scope.domain.id=default&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:14.211905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5425f-2c8e-472a-8320-c00c28af7a96 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:14.232850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:14.252603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37835ac-6f49-4333-981c-bfb337b6df7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:14.253277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37835ac-6f49-4333-981c-bfb337b6df7b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:14.253559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37835ac-6f49-4333-981c-bfb337b6df7b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:14.253828 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37835ac-6f49-4333-981c-bfb337b6df7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:14.255080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37835ac-6f49-4333-981c-bfb337b6df7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:14.256586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37835ac-6f49-4333-981c-bfb337b6df7b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:14.258256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 31/56] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:14.264115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d74d-8f10-4ffb-952c-645fe402b668 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:14.359404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:14.377687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d74d-8f10-4ffb-952c-645fe402b668 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:14.411763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708fcf3-415b-478d-bd99-d4b1098b3228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:14.412402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708fcf3-415b-478d-bd99-d4b1098b3228 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:14.412679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708fcf3-415b-478d-bd99-d4b1098b3228 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:14.412948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708fcf3-415b-478d-bd99-d4b1098b3228 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:14.413635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708fcf3-415b-478d-bd99-d4b1098b3228 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:14.415077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708fcf3-415b-478d-bd99-d4b1098b3228 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:14.442583 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 26/57] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Oct 6 04:18:14 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:16.643268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d604f-1248-454f-aae5-451aa2418eb2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:16.643824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d604f-1248-454f-aae5-451aa2418eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:16.643824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d604f-1248-454f-aae5-451aa2418eb2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:16.645072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 32/58] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:16.651482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333b9ca-6ea6-4b3e-a037-7f4be3695745 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:16.652197 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333b9ca-6ea6-4b3e-a037-7f4be3695745 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:16.652313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333b9ca-6ea6-4b3e-a037-7f4be3695745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:16.679480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e333b9ca-6ea6-4b3e-a037-7f4be3695745 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:16.680681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e333b9ca-6ea6-4b3e-a037-7f4be3695745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:16.751989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 27/59] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:17.022248 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d604f-1248-454f-aae5-451aa2418eb2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:17.249941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d604f-1248-454f-aae5-451aa2418eb2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:17.291910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59d831-8a20-4ed7-93f7-87c2a0e33544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:17.292476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d831-8a20-4ed7-93f7-87c2a0e33544 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:17.292754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d831-8a20-4ed7-93f7-87c2a0e33544 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:17.293024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d831-8a20-4ed7-93f7-87c2a0e33544 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:17.294197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59d831-8a20-4ed7-93f7-87c2a0e33544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:17.295658 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59d831-8a20-4ed7-93f7-87c2a0e33544 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:17.297242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 33/60] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:17.304016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333b9ca-6ea6-4b3e-a037-7f4be3695745 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:17.375047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:17.412753 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333b9ca-6ea6-4b3e-a037-7f4be3695745 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:17.449150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d016a5-7cc1-49b8-a88d-64ec746ce91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:17.449769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d016a5-7cc1-49b8-a88d-64ec746ce91a None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:17.450050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d016a5-7cc1-49b8-a88d-64ec746ce91a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:17.450322 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d016a5-7cc1-49b8-a88d-64ec746ce91a None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:17.450979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d016a5-7cc1-49b8-a88d-64ec746ce91a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:17.452469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d016a5-7cc1-49b8-a88d-64ec746ce91a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:17.483300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 28/61] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:18:17 2022] POST /identity/v3/users => generated 275 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:20.835173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41f74c-4867-4a1e-ab8b-e83cbc44fecd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:20.836056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41f74c-4867-4a1e-ab8b-e83cbc44fecd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:20.836503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41f74c-4867-4a1e-ab8b-e83cbc44fecd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:20.838003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 34/62] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:18:20.845500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd8385-ac65-4e21-8d6d-8d6398a04e40 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:20.846312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd8385-ac65-4e21-8d6d-8d6398a04e40 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:20.846729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd8385-ac65-4e21-8d6d-8d6398a04e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:20.872445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-54dd8385-ac65-4e21-8d6d-8d6398a04e40 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:20.873896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-54dd8385-ac65-4e21-8d6d-8d6398a04e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:20.949422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fb3f3-8913-44ba-90c7-8948ab33a360 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:20.949938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fb3f3-8913-44ba-90c7-8948ab33a360 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:20.950385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fb3f3-8913-44ba-90c7-8948ab33a360 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:20.951927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 35/63] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:18:20.968432 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af468799-b4f1-4939-8258-4101ca7d7599 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:20.968937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af468799-b4f1-4939-8258-4101ca7d7599 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:20.969354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af468799-b4f1-4939-8258-4101ca7d7599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:20.985548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 29/64] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:20.998616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-af468799-b4f1-4939-8258-4101ca7d7599 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:21.000061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-af468799-b4f1-4939-8258-4101ca7d7599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:21.071051 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:21.096912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 36/65] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:21.155067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a96141-662e-47df-8e2e-b5ce88abfbfa None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.155716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a96141-662e-47df-8e2e-b5ce88abfbfa None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.156216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a96141-662e-47df-8e2e-b5ce88abfbfa None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.158080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 30/66] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:21.163228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344a17-dd43-44c6-8fe3-66057020b724 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.163544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344a17-dd43-44c6-8fe3-66057020b724 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.163822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344a17-dd43-44c6-8fe3-66057020b724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.184166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-86344a17-dd43-44c6-8fe3-66057020b724 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:21.185345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-86344a17-dd43-44c6-8fe3-66057020b724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:21.280293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 37/67] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:21.370538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a96141-662e-47df-8e2e-b5ce88abfbfa None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:21.377573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887a3c-de8f-420f-871c-197bc42d0c33 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.377924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887a3c-de8f-420f-871c-197bc42d0c33 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.378120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887a3c-de8f-420f-871c-197bc42d0c33 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.380256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 38/68] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:21.385760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a03f98-2884-4012-ab81-0aedfa12c6e9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.386270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a03f98-2884-4012-ab81-0aedfa12c6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.386752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a03f98-2884-4012-ab81-0aedfa12c6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.405137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-78a03f98-2884-4012-ab81-0aedfa12c6e9 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:21.407040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-78a03f98-2884-4012-ab81-0aedfa12c6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:21.431002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:21.483535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a96141-662e-47df-8e2e-b5ce88abfbfa None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:21.489731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 39/69] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:21.489731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1d79c-ba67-4e6b-b446-9fe69c4a8ff0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.489731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1d79c-ba67-4e6b-b446-9fe69c4a8ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.489731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1d79c-ba67-4e6b-b446-9fe69c4a8ff0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.489731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 40/70] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:21.493799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1d79c-ba67-4e6b-b446-9fe69c4a8ff0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:21.519621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d047-1ea1-4db9-9644-579701f0af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:21.520272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d047-1ea1-4db9-9644-579701f0af46 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.520555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d047-1ea1-4db9-9644-579701f0af46 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.520832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d047-1ea1-4db9-9644-579701f0af46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.531652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006d047-1ea1-4db9-9644-579701f0af46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-0006d047-1ea1-4db9-9644-579701f0af46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:21.537162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:21.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:21.538784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:21.540710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 31/71] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:18:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:21.542546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc812a-80f7-4f2d-bec4-cd024c1c199f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.543012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc812a-80f7-4f2d-bec4-cd024c1c199f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.543513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc812a-80f7-4f2d-bec4-cd024c1c199f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.565674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-fddc812a-80f7-4f2d-bec4-cd024c1c199f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:21.566342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:21.568004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fddc812a-80f7-4f2d-bec4-cd024c1c199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:21.615010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1d79c-ba67-4e6b-b446-9fe69c4a8ff0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:21.646199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 32/72] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:21.646791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc812a-80f7-4f2d-bec4-cd024c1c199f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:21.656389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707d012-4d31-4cc3-8ab0-0dde0552fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:21.657868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d012-4d31-4cc3-8ab0-0dde0552fe78 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.658774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d012-4d31-4cc3-8ab0-0dde0552fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.659571 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d012-4d31-4cc3-8ab0-0dde0552fe78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.675180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707d012-4d31-4cc3-8ab0-0dde0552fe78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4707d012-4d31-4cc3-8ab0-0dde0552fe78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:21.681707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:21.682542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:21.683328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:21.685644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 41/73] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:21.687197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707d012-4d31-4cc3-8ab0-0dde0552fe78 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:21.693590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:21.750079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc812a-80f7-4f2d-bec4-cd024c1c199f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:21.784713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd8424-36ce-4f12-8359-9247a4bfe88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:21.785335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd8424-36ce-4f12-8359-9247a4bfe88e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.785619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd8424-36ce-4f12-8359-9247a4bfe88e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.785901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd8424-36ce-4f12-8359-9247a4bfe88e None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.786579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd8424-36ce-4f12-8359-9247a4bfe88e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:21.786886 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd8424-36ce-4f12-8359-9247a4bfe88e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:21.788322 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd8424-36ce-4f12-8359-9247a4bfe88e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:21.799712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 33/74] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:21.799712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd8424-36ce-4f12-8359-9247a4bfe88e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:21.807259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707d012-4d31-4cc3-8ab0-0dde0552fe78 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:21.810322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:21.843466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78a578-85e6-4602-9cfc-870b90e92a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:21.844120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78a578-85e6-4602-9cfc-870b90e92a8e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.844361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78a578-85e6-4602-9cfc-870b90e92a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.844630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78a578-85e6-4602-9cfc-870b90e92a8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.854765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78a578-85e6-4602-9cfc-870b90e92a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0d78a578-85e6-4602-9cfc-870b90e92a8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:21.859619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:21.860529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:21.861291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 42/75] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:18:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:21.861952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78a578-85e6-4602-9cfc-870b90e92a8e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:21.910288 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd8424-36ce-4f12-8359-9247a4bfe88e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:21.917912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:21.945963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f8b64-b0ee-4499-9d4f-72d9fe4c8f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:21.946574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8b64-b0ee-4499-9d4f-72d9fe4c8f99 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:21.946847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8b64-b0ee-4499-9d4f-72d9fe4c8f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:21.947084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8b64-b0ee-4499-9d4f-72d9fe4c8f99 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:21.947785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f8b64-b0ee-4499-9d4f-72d9fe4c8f99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:21.948085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f8b64-b0ee-4499-9d4f-72d9fe4c8f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:21.949480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f8b64-b0ee-4499-9d4f-72d9fe4c8f99 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:21.958076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 34/76] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:21.958888 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f8b64-b0ee-4499-9d4f-72d9fe4c8f99 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:21.965748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78a578-85e6-4602-9cfc-870b90e92a8e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.000660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294e377-3f58-4511-9b78-43967c33dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.001296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e377-3f58-4511-9b78-43967c33dba2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.001572 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e377-3f58-4511-9b78-43967c33dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.001843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e377-3f58-4511-9b78-43967c33dba2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.011860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294e377-3f58-4511-9b78-43967c33dba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b294e377-3f58-4511-9b78-43967c33dba2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:22.016741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:22.017596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:22.018402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 43/77] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:22.019033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294e377-3f58-4511-9b78-43967c33dba2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:22.043300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:22.060653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f8b64-b0ee-4499-9d4f-72d9fe4c8f99 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.093264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90051ac-0aeb-4b94-91d8-bf36435f9143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.093899 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90051ac-0aeb-4b94-91d8-bf36435f9143 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.094178 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90051ac-0aeb-4b94-91d8-bf36435f9143 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.094447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90051ac-0aeb-4b94-91d8-bf36435f9143 None admin] PATH_INFO: `/v3/users/a648d0c15aec4e95a5b091741686db89` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.095787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90051ac-0aeb-4b94-91d8-bf36435f9143 None admin] RBAC: Authorizing `identity:get_user(user_id=a648d0c15aec4e95a5b091741686db89)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:22.097249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90051ac-0aeb-4b94-91d8-bf36435f9143 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:22.098824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 35/78] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:21 2022] GET /identity/v3/users/a648d0c15aec4e95a5b091741686db89 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:22.099605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90051ac-0aeb-4b94-91d8-bf36435f9143 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:22.119803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294e377-3f58-4511-9b78-43967c33dba2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.135196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:22.160217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f536882-dd55-4119-a50e-6095d7d34658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.160896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f536882-dd55-4119-a50e-6095d7d34658 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.161106 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f536882-dd55-4119-a50e-6095d7d34658 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.161360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f536882-dd55-4119-a50e-6095d7d34658 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.162024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f536882-dd55-4119-a50e-6095d7d34658 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:22.162328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f536882-dd55-4119-a50e-6095d7d34658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:22.163755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f536882-dd55-4119-a50e-6095d7d34658 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:22.171828 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 44/79] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:18:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:22.172443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f536882-dd55-4119-a50e-6095d7d34658 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:22.201708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90051ac-0aeb-4b94-91d8-bf36435f9143 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.234606 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca052eb-d455-4022-a77b-fe025b04908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.235245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca052eb-d455-4022-a77b-fe025b04908d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.235579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca052eb-d455-4022-a77b-fe025b04908d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.236176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca052eb-d455-4022-a77b-fe025b04908d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.237083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca052eb-d455-4022-a77b-fe025b04908d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:22.238590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca052eb-d455-4022-a77b-fe025b04908d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:22.240161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 36/80] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:22.241033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca052eb-d455-4022-a77b-fe025b04908d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:22.261195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:22.276924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f536882-dd55-4119-a50e-6095d7d34658 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.310092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b3334-fe2c-4ee0-a9f9-4244658a5e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.310731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b3334-fe2c-4ee0-a9f9-4244658a5e56 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.311015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b3334-fe2c-4ee0-a9f9-4244658a5e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.311284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b3334-fe2c-4ee0-a9f9-4244658a5e56 None admin] PATH_INFO: `/v3/users/f7676517cf3c47a0a7ed6087713bb3e8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.327709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b3334-fe2c-4ee0-a9f9-4244658a5e56 None admin] RBAC: Authorizing `identity:get_user(user_id=f7676517cf3c47a0a7ed6087713bb3e8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:22.329225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b3334-fe2c-4ee0-a9f9-4244658a5e56 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:22.330918 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 45/81] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:22 2022] GET /identity/v3/users/f7676517cf3c47a0a7ed6087713bb3e8 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:22.331717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b3334-fe2c-4ee0-a9f9-4244658a5e56 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:22.342214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca052eb-d455-4022-a77b-fe025b04908d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.344658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:22.377680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028ca1b-f574-4594-b9b6-6eaac87d1db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.378270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028ca1b-f574-4594-b9b6-6eaac87d1db3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.378546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028ca1b-f574-4594-b9b6-6eaac87d1db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.378818 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028ca1b-f574-4594-b9b6-6eaac87d1db3 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.379514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028ca1b-f574-4594-b9b6-6eaac87d1db3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:22.379819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028ca1b-f574-4594-b9b6-6eaac87d1db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:22.381206 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028ca1b-f574-4594-b9b6-6eaac87d1db3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:22.389302 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 37/82] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:22.389897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028ca1b-f574-4594-b9b6-6eaac87d1db3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:22.438432 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b3334-fe2c-4ee0-a9f9-4244658a5e56 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.471679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f888647-7124-422c-a290-faf72d080af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.472293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f888647-7124-422c-a290-faf72d080af8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.472567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f888647-7124-422c-a290-faf72d080af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.472848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f888647-7124-422c-a290-faf72d080af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.486666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:22.488121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028ca1b-f574-4594-b9b6-6eaac87d1db3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.527613 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff78ac7-489b-4f73-8552-e17379aaedb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.528257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff78ac7-489b-4f73-8552-e17379aaedb6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.528536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff78ac7-489b-4f73-8552-e17379aaedb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.528813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff78ac7-489b-4f73-8552-e17379aaedb6 None admin] PATH_INFO: `/v3/users/f7676517cf3c47a0a7ed6087713bb3e8` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.529974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff78ac7-489b-4f73-8552-e17379aaedb6 None admin] RBAC: Authorizing `identity:get_user(user_id=f7676517cf3c47a0a7ed6087713bb3e8)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:22.531484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff78ac7-489b-4f73-8552-e17379aaedb6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:22.533148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 38/83] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:22 2022] GET /identity/v3/users/f7676517cf3c47a0a7ed6087713bb3e8 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:22.533834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff78ac7-489b-4f73-8552-e17379aaedb6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:22.544738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f888647-7124-422c-a290-faf72d080af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:22.546255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f888647-7124-422c-a290-faf72d080af8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:22.568269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:22.635318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff78ac7-489b-4f73-8552-e17379aaedb6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.647625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 46/84] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:22.648453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f888647-7124-422c-a290-faf72d080af8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:22.670748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea21ec-1a85-4c8b-92b8-0038ac4fd186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.671396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea21ec-1a85-4c8b-92b8-0038ac4fd186 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.671676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea21ec-1a85-4c8b-92b8-0038ac4fd186 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.671955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea21ec-1a85-4c8b-92b8-0038ac4fd186 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.672614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea21ec-1a85-4c8b-92b8-0038ac4fd186 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:22.674752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea21ec-1a85-4c8b-92b8-0038ac4fd186 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:22.696340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 39/85] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:18:22 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:22.696491 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:22.697505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea21ec-1a85-4c8b-92b8-0038ac4fd186 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:22.778479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f888647-7124-422c-a290-faf72d080af8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.801033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:22.815109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea21ec-1a85-4c8b-92b8-0038ac4fd186 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:22.822519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b24152-bfff-4ff6-bfeb-c2b71b93f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.823153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b24152-bfff-4ff6-bfeb-c2b71b93f489 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.823997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b24152-bfff-4ff6-bfeb-c2b71b93f489 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.824280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b24152-bfff-4ff6-bfeb-c2b71b93f489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.853969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c8de5-f380-43dc-9c72-e0662dbde59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:22.855575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c8de5-f380-43dc-9c72-e0662dbde59d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:22.856102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c8de5-f380-43dc-9c72-e0662dbde59d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:22.856541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c8de5-f380-43dc-9c72-e0662dbde59d None admin] PATH_INFO: `/v3/users/f7676517cf3c47a0a7ed6087713bb3e8` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:22.858911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c8de5-f380-43dc-9c72-e0662dbde59d None admin] RBAC: Authorizing `identity:get_user(user_id=f7676517cf3c47a0a7ed6087713bb3e8)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:22.861388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c8de5-f380-43dc-9c72-e0662dbde59d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:22.863447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 40/86] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:22 2022] GET /identity/v3/users/f7676517cf3c47a0a7ed6087713bb3e8 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:22.864674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c8de5-f380-43dc-9c72-e0662dbde59d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:22.906468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b24152-bfff-4ff6-bfeb-c2b71b93f489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:22.907476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b24152-bfff-4ff6-bfeb-c2b71b93f489 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:22.959606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:22.981450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c8de5-f380-43dc-9c72-e0662dbde59d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:23.029310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd09145-276e-40d0-80e8-9ecafa254825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:23.030023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd09145-276e-40d0-80e8-9ecafa254825 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:23.030415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd09145-276e-40d0-80e8-9ecafa254825 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:23.030694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd09145-276e-40d0-80e8-9ecafa254825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:23.034990 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 47/87] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:23.036058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b24152-bfff-4ff6-bfeb-c2b71b93f489 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:23.062641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:23.107581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd09145-276e-40d0-80e8-9ecafa254825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:23.109230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd09145-276e-40d0-80e8-9ecafa254825 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:23.162486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b24152-bfff-4ff6-bfeb-c2b71b93f489 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:23.200441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4ff79-49d9-4ba7-92ed-ef2828b68a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:23.201615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4ff79-49d9-4ba7-92ed-ef2828b68a22 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:23.202037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4ff79-49d9-4ba7-92ed-ef2828b68a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:23.202549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4ff79-49d9-4ba7-92ed-ef2828b68a22 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:23.203854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4ff79-49d9-4ba7-92ed-ef2828b68a22 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:23.205772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4ff79-49d9-4ba7-92ed-ef2828b68a22 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:23.207913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 48/88] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:23 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:23.208893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4ff79-49d9-4ba7-92ed-ef2828b68a22 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:23.220828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 41/89] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:23.221714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd09145-276e-40d0-80e8-9ecafa254825 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:23.226260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:23.287211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:23.329031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4ff79-49d9-4ba7-92ed-ef2828b68a22 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:23.342092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd09145-276e-40d0-80e8-9ecafa254825 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:23.369967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd1875-f129-4d42-8e46-bb29758757f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:23.370599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd1875-f129-4d42-8e46-bb29758757f5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:23.370962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd1875-f129-4d42-8e46-bb29758757f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:23.371235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd1875-f129-4d42-8e46-bb29758757f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:23.385575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1f3c-7c97-4616-9ebd-0a84a1286e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:23.386565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1f3c-7c97-4616-9ebd-0a84a1286e16 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:23.387024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1f3c-7c97-4616-9ebd-0a84a1286e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:23.387519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1f3c-7c97-4616-9ebd-0a84a1286e16 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:23.389303 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f1f3c-7c97-4616-9ebd-0a84a1286e16 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:23.392102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f1f3c-7c97-4616-9ebd-0a84a1286e16 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:23.402386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 42/90] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:23 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:23.403846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1f3c-7c97-4616-9ebd-0a84a1286e16 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:23.488509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd1875-f129-4d42-8e46-bb29758757f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:23.491068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd1875-f129-4d42-8e46-bb29758757f5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:23.508524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:23.547069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1f3c-7c97-4616-9ebd-0a84a1286e16 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:23.576438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:23.585596 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0df1-f239-4af6-9435-dd0b37363446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:23.586214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0df1-f239-4af6-9435-dd0b37363446 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:23.586489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0df1-f239-4af6-9435-dd0b37363446 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:23.586760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0df1-f239-4af6-9435-dd0b37363446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:23.587529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c0df1-f239-4af6-9435-dd0b37363446 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1, user.id=a648d0c15aec4e95a5b091741686db89) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:23.587837 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c0df1-f239-4af6-9435-dd0b37363446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:23.589386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c0df1-f239-4af6-9435-dd0b37363446 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:23.596201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 43/91] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:23 2022] GET /identity/v3/role_assignments?user.id=a648d0c15aec4e95a5b091741686db89&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:23.597002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0df1-f239-4af6-9435-dd0b37363446 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:23.621006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 49/92] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:23.623058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd1875-f129-4d42-8e46-bb29758757f5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:23.775444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd1875-f129-4d42-8e46-bb29758757f5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:23.795340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:23.809589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0df1-f239-4af6-9435-dd0b37363446 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:23.832775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432a98-8ed5-43ec-b230-a9223420ca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:23.834444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432a98-8ed5-43ec-b230-a9223420ca37 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:23.835085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432a98-8ed5-43ec-b230-a9223420ca37 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:23.837122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432a98-8ed5-43ec-b230-a9223420ca37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:23.838104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432a98-8ed5-43ec-b230-a9223420ca37 None admin] RBAC: Adding query filter params (role.id=ec48f4c280dd43db99923e3badf5fe36, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1, user.id=f7676517cf3c47a0a7ed6087713bb3e8) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:23.839788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432a98-8ed5-43ec-b230-a9223420ca37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:23.841452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432a98-8ed5-43ec-b230-a9223420ca37 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:23.857269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 50/93] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:23 2022] GET /identity/v3/role_assignments?user.id=f7676517cf3c47a0a7ed6087713bb3e8&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:23.860490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432a98-8ed5-43ec-b230-a9223420ca37 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:23.888716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28c46a-85ba-4843-ac19-fb2dcb36ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:23.889755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28c46a-85ba-4843-ac19-fb2dcb36ea2a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:23.891656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28c46a-85ba-4843-ac19-fb2dcb36ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:23.892137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28c46a-85ba-4843-ac19-fb2dcb36ea2a None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:23.893963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28c46a-85ba-4843-ac19-fb2dcb36ea2a None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:23.897697 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28c46a-85ba-4843-ac19-fb2dcb36ea2a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:23.902196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 44/94] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:23 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:23.908676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28c46a-85ba-4843-ac19-fb2dcb36ea2a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:24.045668 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:24.062302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432a98-8ed5-43ec-b230-a9223420ca37 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:24.099551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956bf6e-50e8-4d58-8370-31f6f692aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:24.100207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956bf6e-50e8-4d58-8370-31f6f692aa61 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:24.100490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956bf6e-50e8-4d58-8370-31f6f692aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:24.100765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956bf6e-50e8-4d58-8370-31f6f692aa61 None admin] PATH_INFO: `/v3/projects/cba7cbd512de467591da418cbc118657` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:24.101919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956bf6e-50e8-4d58-8370-31f6f692aa61 None admin] RBAC: Authorizing `identity:get_project(project_id=cba7cbd512de467591da418cbc118657)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:24.103430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956bf6e-50e8-4d58-8370-31f6f692aa61 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:24.105134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 51/95] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:23 2022] GET /identity/v3/projects/cba7cbd512de467591da418cbc118657 => generated 312 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:24.111093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956bf6e-50e8-4d58-8370-31f6f692aa61 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:24.132620 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28c46a-85ba-4843-ac19-fb2dcb36ea2a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:24.181153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:24.197276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df113ff-8cc5-46cc-9625-1dc9ee132249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:24.197963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df113ff-8cc5-46cc-9625-1dc9ee132249 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:24.198246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df113ff-8cc5-46cc-9625-1dc9ee132249 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:24.198515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df113ff-8cc5-46cc-9625-1dc9ee132249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:24.199257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df113ff-8cc5-46cc-9625-1dc9ee132249 None admin] RBAC: Adding query filter params (role.id=35a096ec554741cb99e599760e23fe4d, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1, user.id=f7676517cf3c47a0a7ed6087713bb3e8) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:24.199591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df113ff-8cc5-46cc-9625-1dc9ee132249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:24.201068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df113ff-8cc5-46cc-9625-1dc9ee132249 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:24.212213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 45/96] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:23 2022] GET /identity/v3/role_assignments?user.id=f7676517cf3c47a0a7ed6087713bb3e8&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=35a096ec554741cb99e599760e23fe4d => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:24.248759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956bf6e-50e8-4d58-8370-31f6f692aa61 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:24.286143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103d2ca-3b99-4f9d-9069-c4461fbaf138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:24.286767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103d2ca-3b99-4f9d-9069-c4461fbaf138 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:24.287048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103d2ca-3b99-4f9d-9069-c4461fbaf138 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:24.287352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103d2ca-3b99-4f9d-9069-c4461fbaf138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:24.288101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103d2ca-3b99-4f9d-9069-c4461fbaf138 None admin] RBAC: Adding query filter params (role.id=ec48f4c280dd43db99923e3badf5fe36, scope.project.id=cba7cbd512de467591da418cbc118657, user.id=f7676517cf3c47a0a7ed6087713bb3e8) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:24.288412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103d2ca-3b99-4f9d-9069-c4461fbaf138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:24.289919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103d2ca-3b99-4f9d-9069-c4461fbaf138 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:24.296760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 52/97] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:24 2022] GET /identity/v3/role_assignments?user.id=f7676517cf3c47a0a7ed6087713bb3e8&scope.project.id=cba7cbd512de467591da418cbc118657&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:25.362766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cc0b7-1ac5-4482-a711-818a0d8e6636 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:25.363843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cc0b7-1ac5-4482-a711-818a0d8e6636 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:25.364311 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cc0b7-1ac5-4482-a711-818a0d8e6636 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:25.365867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 46/98] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:25.372256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef135c4f-b91c-457d-bf6f-ff2887c227e5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:25.373175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef135c4f-b91c-457d-bf6f-ff2887c227e5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:25.373662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef135c4f-b91c-457d-bf6f-ff2887c227e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:25.398173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ef135c4f-b91c-457d-bf6f-ff2887c227e5 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:25.399827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ef135c4f-b91c-457d-bf6f-ff2887c227e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:25.475485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 53/99] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:25.557974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb30744-c759-4d28-b34a-0d4b2de11fb5 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:25.558602 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb30744-c759-4d28-b34a-0d4b2de11fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:25.559131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb30744-c759-4d28-b34a-0d4b2de11fb5 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:25.560709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 47/100] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:25.570524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fae8d-bcaa-45b3-88ed-e128d9e4e157 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:25.571043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fae8d-bcaa-45b3-88ed-e128d9e4e157 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:25.571543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fae8d-bcaa-45b3-88ed-e128d9e4e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:25.595392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-795fae8d-bcaa-45b3-88ed-e128d9e4e157 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:25.596980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-795fae8d-bcaa-45b3-88ed-e128d9e4e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:25.629020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:25.679741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 54/101] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:25.963062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb30744-c759-4d28-b34a-0d4b2de11fb5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:26.100796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb30744-c759-4d28-b34a-0d4b2de11fb5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:26.134708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:26.148666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2578b-e882-4a4e-9156-f03a862819a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:26.149316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2578b-e882-4a4e-9156-f03a862819a1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:26.149592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2578b-e882-4a4e-9156-f03a862819a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:26.149861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2578b-e882-4a4e-9156-f03a862819a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:26.150959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2578b-e882-4a4e-9156-f03a862819a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:26.152513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2578b-e882-4a4e-9156-f03a862819a1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:26.154260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 48/102] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:26.160265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fae8d-bcaa-45b3-88ed-e128d9e4e157 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:26.205057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2578b-e882-4a4e-9156-f03a862819a1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:26.329726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fae8d-bcaa-45b3-88ed-e128d9e4e157 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:26.387503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2578b-e882-4a4e-9156-f03a862819a1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:26.392076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625a2f-6443-41b5-85a2-195927e6e047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:26.392776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625a2f-6443-41b5-85a2-195927e6e047 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:26.393062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625a2f-6443-41b5-85a2-195927e6e047 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:26.393335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625a2f-6443-41b5-85a2-195927e6e047 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:26.394005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a625a2f-6443-41b5-85a2-195927e6e047 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:26.395516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a625a2f-6443-41b5-85a2-195927e6e047 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:26.452248 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 55/103] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:18:26 2022] POST /identity/v3/projects => generated 302 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:26.456875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438e90e-e951-45af-9178-5731689e0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:26.457562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438e90e-e951-45af-9178-5731689e0e68 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:26.457846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438e90e-e951-45af-9178-5731689e0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:26.458119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438e90e-e951-45af-9178-5731689e0e68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:26.479513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438e90e-e951-45af-9178-5731689e0e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a438e90e-e951-45af-9178-5731689e0e68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:26.485185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:26.486599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:26.487802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 49/104] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:26.493685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625a2f-6443-41b5-85a2-195927e6e047 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:26.527939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:26.601903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e0176-7afb-48d5-a994-23ecb29d4eb6 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:26.602085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e0176-7afb-48d5-a994-23ecb29d4eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:26.602361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e0176-7afb-48d5-a994-23ecb29d4eb6 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:26.603943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 50/105] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:18:26.608862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12c76c-b02f-4af0-a81d-3bb314987c28 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:26.609156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12c76c-b02f-4af0-a81d-3bb314987c28 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:26.609436 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12c76c-b02f-4af0-a81d-3bb314987c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:26.640953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-df12c76c-b02f-4af0-a81d-3bb314987c28 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:26.642473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-df12c76c-b02f-4af0-a81d-3bb314987c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:26.645766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625a2f-6443-41b5-85a2-195927e6e047 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:26.717524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd293293-129c-407a-ac04-57f005ca26a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:26.718160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd293293-129c-407a-ac04-57f005ca26a8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:26.718439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd293293-129c-407a-ac04-57f005ca26a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:26.718710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd293293-129c-407a-ac04-57f005ca26a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:26.719523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd293293-129c-407a-ac04-57f005ca26a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:26.719891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd293293-129c-407a-ac04-57f005ca26a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:26.721296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd293293-129c-407a-ac04-57f005ca26a8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:26.726333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:26.744342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 56/106] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:26.750019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd293293-129c-407a-ac04-57f005ca26a8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:26.767116 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 51/107] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:26.876812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:26.898769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd293293-129c-407a-ac04-57f005ca26a8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:26.944227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37951911-4e27-4317-b6e5-b4a690c452dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:26.944876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37951911-4e27-4317-b6e5-b4a690c452dd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:26.945154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37951911-4e27-4317-b6e5-b4a690c452dd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:26.945425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37951911-4e27-4317-b6e5-b4a690c452dd None admin] PATH_INFO: `/v3/users/3ef679f64c3b42df9f2763c2d3144855` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:26.969067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37951911-4e27-4317-b6e5-b4a690c452dd None admin] RBAC: Authorizing `identity:get_user(user_id=3ef679f64c3b42df9f2763c2d3144855)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:26.970666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37951911-4e27-4317-b6e5-b4a690c452dd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:26.972401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 57/108] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:26 2022] GET /identity/v3/users/3ef679f64c3b42df9f2763c2d3144855 => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:26.978104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12c76c-b02f-4af0-a81d-3bb314987c28 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:27.124038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12c76c-b02f-4af0-a81d-3bb314987c28 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:27.177027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37819df3-def9-48f9-af5b-c3642902e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:27.177572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819df3-def9-48f9-af5b-c3642902e8ae None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.177854 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819df3-def9-48f9-af5b-c3642902e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.178315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819df3-def9-48f9-af5b-c3642902e8ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.221464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37951911-4e27-4317-b6e5-b4a690c452dd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:27.245158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:27.273575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37819df3-def9-48f9-af5b-c3642902e8ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:27.275083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37819df3-def9-48f9-af5b-c3642902e8ae None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:27.449825 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37951911-4e27-4317-b6e5-b4a690c452dd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:27.474958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 52/109] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:27.476105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e75d-9327-4f04-b28d-fc0de583e52a None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.476386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e75d-9327-4f04-b28d-fc0de583e52a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.476664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e75d-9327-4f04-b28d-fc0de583e52a None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.479642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 53/110] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:27.481056 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e75d-9327-4f04-b28d-fc0de583e52a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:27.517307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db216e-7898-4dc5-8597-af4286f227cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:27.518878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db216e-7898-4dc5-8597-af4286f227cd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.519397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db216e-7898-4dc5-8597-af4286f227cd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.519875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db216e-7898-4dc5-8597-af4286f227cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.529758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:27.534989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db216e-7898-4dc5-8597-af4286f227cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-42db216e-7898-4dc5-8597-af4286f227cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:27.543706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:27.544660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:27.545409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:27.548783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 58/111] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:27.551786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424332e-103e-4800-8916-544f40c0ae2f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.552375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424332e-103e-4800-8916-544f40c0ae2f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.552897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424332e-103e-4800-8916-544f40c0ae2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.577998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8424332e-103e-4800-8916-544f40c0ae2f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:27.580783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8424332e-103e-4800-8916-544f40c0ae2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:27.605336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:27.632939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e75d-9327-4f04-b28d-fc0de583e52a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:27.670895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 59/112] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:27.672289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37af7-b8b3-4986-ba4a-60f7ff1f4fbf None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.672575 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37af7-b8b3-4986-ba4a-60f7ff1f4fbf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.672965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37af7-b8b3-4986-ba4a-60f7ff1f4fbf None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.674292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 60/113] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:27.674979 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb37af7-b8b3-4986-ba4a-60f7ff1f4fbf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:27.685430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622c11b-94a4-4918-9c35-21d6259efa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:27.686084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622c11b-94a4-4918-9c35-21d6259efa41 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.686351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622c11b-94a4-4918-9c35-21d6259efa41 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.686616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622c11b-94a4-4918-9c35-21d6259efa41 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.687774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622c11b-94a4-4918-9c35-21d6259efa41 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:27.689406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622c11b-94a4-4918-9c35-21d6259efa41 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:27.691381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 54/114] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:27 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:27.692615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4ed84-e3bc-4b91-b2c5-1ff778a4f456 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.692893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4ed84-e3bc-4b91-b2c5-1ff778a4f456 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.693159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4ed84-e3bc-4b91-b2c5-1ff778a4f456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.712724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8fb4ed84-e3bc-4b91-b2c5-1ff778a4f456 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:27.713895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8fb4ed84-e3bc-4b91-b2c5-1ff778a4f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:27.788809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 55/115] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:27.790651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aae9d1-05ba-47c0-bb24-631a0730cff3 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.791144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aae9d1-05ba-47c0-bb24-631a0730cff3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.791593 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aae9d1-05ba-47c0-bb24-631a0730cff3 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.797349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 56/116] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:27.798187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aae9d1-05ba-47c0-bb24-631a0730cff3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:27.800954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb37af7-b8b3-4986-ba4a-60f7ff1f4fbf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:27.832556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:27.839678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715a1e1-4ab1-4143-bb64-b9b6d3fb17f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:27.840542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715a1e1-4ab1-4143-bb64-b9b6d3fb17f4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.841023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715a1e1-4ab1-4143-bb64-b9b6d3fb17f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.841486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715a1e1-4ab1-4143-bb64-b9b6d3fb17f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.842439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715a1e1-4ab1-4143-bb64-b9b6d3fb17f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:27.842931 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715a1e1-4ab1-4143-bb64-b9b6d3fb17f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:27.844768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715a1e1-4ab1-4143-bb64-b9b6d3fb17f4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:27.854963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 61/117] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:27.861189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1267-9584-4a3a-abe0-9bae4c66246f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.862150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1267-9584-4a3a-abe0-9bae4c66246f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.862884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1267-9584-4a3a-abe0-9bae4c66246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.892119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:27.900343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-598c1267-9584-4a3a-abe0-9bae4c66246f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:27.901546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-598c1267-9584-4a3a-abe0-9bae4c66246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:27.935745 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aae9d1-05ba-47c0-bb24-631a0730cff3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:27.996490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8e128-8a93-46b2-b000-216b04e20853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:27.997022 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8e128-8a93-46b2-b000-216b04e20853 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:27.997305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8e128-8a93-46b2-b000-216b04e20853 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:27.997578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8e128-8a93-46b2-b000-216b04e20853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:27.998315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8e128-8a93-46b2-b000-216b04e20853 None admin] RBAC: Adding query filter params (role.id=3d821a5c8fb04a569b693bc2a5feb1da, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1, user.id=3ef679f64c3b42df9f2763c2d3144855) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:27.998624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8e128-8a93-46b2-b000-216b04e20853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:28.000849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8e128-8a93-46b2-b000-216b04e20853 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:28.008205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 57/118] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:27 2022] GET /identity/v3/role_assignments?user.id=3ef679f64c3b42df9f2763c2d3144855&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=3d821a5c8fb04a569b693bc2a5feb1da => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:28.009314 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8e128-8a93-46b2-b000-216b04e20853 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:28.014426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 62/119] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:28.015238 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c1267-9584-4a3a-abe0-9bae4c66246f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:28.169763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8e128-8a93-46b2-b000-216b04e20853 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:28.180011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c1267-9584-4a3a-abe0-9bae4c66246f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:28.206776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:28.216256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc739d-8422-4eee-9155-078a23db3ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:28.217410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc739d-8422-4eee-9155-078a23db3ecf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:28.217921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc739d-8422-4eee-9155-078a23db3ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:28.218428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc739d-8422-4eee-9155-078a23db3ecf None admin] PATH_INFO: `/v3/users/a648d0c15aec4e95a5b091741686db89` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:28.220224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea042d2-071d-4d67-88c9-165ab353e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:28.220814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc739d-8422-4eee-9155-078a23db3ecf None admin] RBAC: Authorizing `identity:get_user(user_id=a648d0c15aec4e95a5b091741686db89)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:28.220917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea042d2-071d-4d67-88c9-165ab353e409 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:28.221141 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea042d2-071d-4d67-88c9-165ab353e409 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:28.221413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea042d2-071d-4d67-88c9-165ab353e409 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:28.223086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc739d-8422-4eee-9155-078a23db3ecf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:28.225209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 58/120] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:28 2022] GET /identity/v3/users/a648d0c15aec4e95a5b091741686db89 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:28.229330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc739d-8422-4eee-9155-078a23db3ecf None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:28.249961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea042d2-071d-4d67-88c9-165ab353e409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7ea042d2-071d-4d67-88c9-165ab353e409 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:28.258423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:28.261592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:28.262482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:28.265351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:28.271395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 63/121] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:28.272801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea042d2-071d-4d67-88c9-165ab353e409 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:28.382501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc739d-8422-4eee-9155-078a23db3ecf None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:28.390819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea042d2-071d-4d67-88c9-165ab353e409 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:28.419731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9849a9c-3982-4024-8cc2-48cbec45a10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:28.420849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9849a9c-3982-4024-8cc2-48cbec45a10f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:28.421370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9849a9c-3982-4024-8cc2-48cbec45a10f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:28.421839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9849a9c-3982-4024-8cc2-48cbec45a10f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:28.425979 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75dca5-a23b-4fd3-b5ff-7cd059024b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:28.426634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75dca5-a23b-4fd3-b5ff-7cd059024b3a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:28.426914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75dca5-a23b-4fd3-b5ff-7cd059024b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:28.427185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75dca5-a23b-4fd3-b5ff-7cd059024b3a None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:28.428356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75dca5-a23b-4fd3-b5ff-7cd059024b3a None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:28.429827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75dca5-a23b-4fd3-b5ff-7cd059024b3a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:28.431694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 64/122] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:28 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:28.436649 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75dca5-a23b-4fd3-b5ff-7cd059024b3a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:28.441930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9849a9c-3982-4024-8cc2-48cbec45a10f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a9849a9c-3982-4024-8cc2-48cbec45a10f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:28.448643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:28.449535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:28.450417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 59/123] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:28.451066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9849a9c-3982-4024-8cc2-48cbec45a10f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:28.505389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:28.540299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:28.568411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75dca5-a23b-4fd3-b5ff-7cd059024b3a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:28.581913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9849a9c-3982-4024-8cc2-48cbec45a10f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:28.610129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede2e4b-c8c5-48aa-bbb6-0e8b08521a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:28.611886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede2e4b-c8c5-48aa-bbb6-0e8b08521a47 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:28.612346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede2e4b-c8c5-48aa-bbb6-0e8b08521a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:28.612942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede2e4b-c8c5-48aa-bbb6-0e8b08521a47 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:28.614280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede2e4b-c8c5-48aa-bbb6-0e8b08521a47 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:28.614835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede2e4b-c8c5-48aa-bbb6-0e8b08521a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:28.617248 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede2e4b-c8c5-48aa-bbb6-0e8b08521a47 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:28.621874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70aa09-6765-4f63-b3f5-40260925dbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:28.622623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70aa09-6765-4f63-b3f5-40260925dbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:28.622999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70aa09-6765-4f63-b3f5-40260925dbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:28.623404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70aa09-6765-4f63-b3f5-40260925dbe2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:28.628017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 65/124] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:28.628974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede2e4b-c8c5-48aa-bbb6-0e8b08521a47 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:28.641796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70aa09-6765-4f63-b3f5-40260925dbe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1e70aa09-6765-4f63-b3f5-40260925dbe2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:28.648516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:28.649376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:28.650169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:28.652822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 60/125] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:18:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:28.653756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70aa09-6765-4f63-b3f5-40260925dbe2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:28.763250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede2e4b-c8c5-48aa-bbb6-0e8b08521a47 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:28.767719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70aa09-6765-4f63-b3f5-40260925dbe2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:28.779223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:28.804870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d56fc3-b3fa-46ec-b969-b8deb0e86273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:28.805945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56fc3-b3fa-46ec-b969-b8deb0e86273 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:28.806672 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56fc3-b3fa-46ec-b969-b8deb0e86273 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:28.807374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56fc3-b3fa-46ec-b969-b8deb0e86273 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/users/a648d0c15aec4e95a5b091741686db89/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:28.808668 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:28.810029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d56fc3-b3fa-46ec-b969-b8deb0e86273 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa5748b82a34c06a18f092a19b0b6c1, user_id=a648d0c15aec4e95a5b091741686db89, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:28.811844 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d56fc3-b3fa-46ec-b969-b8deb0e86273 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:28.816578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab01b3-19b3-4d13-9913-53d3cb64acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:28.817796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab01b3-19b3-4d13-9913-53d3cb64acb1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:28.818405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab01b3-19b3-4d13-9913-53d3cb64acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:28.818780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab01b3-19b3-4d13-9913-53d3cb64acb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:28.819773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab01b3-19b3-4d13-9913-53d3cb64acb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:28.820149 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab01b3-19b3-4d13-9913-53d3cb64acb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:28.822040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab01b3-19b3-4d13-9913-53d3cb64acb1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:28.832375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 66/126] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:18:28 2022] PUT /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/users/a648d0c15aec4e95a5b091741686db89/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:18:28.833567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d56fc3-b3fa-46ec-b969-b8deb0e86273 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:28.846876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 61/127] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:28.846876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab01b3-19b3-4d13-9913-53d3cb64acb1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:29.035898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d56fc3-b3fa-46ec-b969-b8deb0e86273 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:29.075207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c3e2b-f01b-4bf0-abe4-dcbaa4779faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:29.076628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3e2b-f01b-4bf0-abe4-dcbaa4779faf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:29.077087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3e2b-f01b-4bf0-abe4-dcbaa4779faf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:29.077797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3e2b-f01b-4bf0-abe4-dcbaa4779faf None admin] PATH_INFO: `/v3/users/f7676517cf3c47a0a7ed6087713bb3e8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:29.079209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c3e2b-f01b-4bf0-abe4-dcbaa4779faf None admin] RBAC: Authorizing `identity:get_user(user_id=f7676517cf3c47a0a7ed6087713bb3e8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:29.081432 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c3e2b-f01b-4bf0-abe4-dcbaa4779faf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:29.083293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 67/128] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:28 2022] GET /identity/v3/users/f7676517cf3c47a0a7ed6087713bb3e8 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:29.084264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c3e2b-f01b-4bf0-abe4-dcbaa4779faf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:29.086675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab01b3-19b3-4d13-9913-53d3cb64acb1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:29.130576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0662a3-46e8-4eaf-9380-4530c2f61f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:29.131327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0662a3-46e8-4eaf-9380-4530c2f61f9a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:29.131683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0662a3-46e8-4eaf-9380-4530c2f61f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:29.132024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0662a3-46e8-4eaf-9380-4530c2f61f9a None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:29.132766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0662a3-46e8-4eaf-9380-4530c2f61f9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:29.133136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0662a3-46e8-4eaf-9380-4530c2f61f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:29.135449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0662a3-46e8-4eaf-9380-4530c2f61f9a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:29.137507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:29.147274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 62/129] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:18:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:29.148641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0662a3-46e8-4eaf-9380-4530c2f61f9a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:29.208873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c3e2b-f01b-4bf0-abe4-dcbaa4779faf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:29.218479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:29.251855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6dfdc-6c27-435f-a6b6-a4ebcb73de86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:29.252520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6dfdc-6c27-435f-a6b6-a4ebcb73de86 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:29.252808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6dfdc-6c27-435f-a6b6-a4ebcb73de86 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:29.253090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6dfdc-6c27-435f-a6b6-a4ebcb73de86 None admin] PATH_INFO: `/v3/users/f7676517cf3c47a0a7ed6087713bb3e8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:29.254719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6dfdc-6c27-435f-a6b6-a4ebcb73de86 None admin] RBAC: Authorizing `identity:get_user(user_id=f7676517cf3c47a0a7ed6087713bb3e8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:29.256506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6dfdc-6c27-435f-a6b6-a4ebcb73de86 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:29.258283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 68/130] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:29 2022] GET /identity/v3/users/f7676517cf3c47a0a7ed6087713bb3e8 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:29.258900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6dfdc-6c27-435f-a6b6-a4ebcb73de86 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:29.273830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0662a3-46e8-4eaf-9380-4530c2f61f9a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:29.339347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b09947-b640-4e87-8548-2bdddbc7a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:29.339347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b09947-b640-4e87-8548-2bdddbc7a031 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:29.339347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b09947-b640-4e87-8548-2bdddbc7a031 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:29.339347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b09947-b640-4e87-8548-2bdddbc7a031 None admin] PATH_INFO: `/v3/projects/cba7cbd512de467591da418cbc118657` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:29.339744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b09947-b640-4e87-8548-2bdddbc7a031 None admin] RBAC: Authorizing `identity:get_project(project_id=cba7cbd512de467591da418cbc118657)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:29.340508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b09947-b640-4e87-8548-2bdddbc7a031 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:29.342346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 63/131] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:29 2022] GET /identity/v3/projects/cba7cbd512de467591da418cbc118657 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:29.343444 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b09947-b640-4e87-8548-2bdddbc7a031 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:29.473249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6dfdc-6c27-435f-a6b6-a4ebcb73de86 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:29.499364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:29.541688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b09947-b640-4e87-8548-2bdddbc7a031 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:29.546209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000a8d9-a66b-4739-8741-c0bb8ee15455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:29.546209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000a8d9-a66b-4739-8741-c0bb8ee15455 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:29.546209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000a8d9-a66b-4739-8741-c0bb8ee15455 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:29.546209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000a8d9-a66b-4739-8741-c0bb8ee15455 None admin] PATH_INFO: `/v3/users/f7676517cf3c47a0a7ed6087713bb3e8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:29.547552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000a8d9-a66b-4739-8741-c0bb8ee15455 None admin] RBAC: Authorizing `identity:get_user(user_id=f7676517cf3c47a0a7ed6087713bb3e8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:29.549406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000a8d9-a66b-4739-8741-c0bb8ee15455 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:29.555651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 69/132] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:29 2022] GET /identity/v3/users/f7676517cf3c47a0a7ed6087713bb3e8 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:29.556562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000a8d9-a66b-4739-8741-c0bb8ee15455 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:29.580231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:29.598189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca9afc-5b99-498d-89eb-5fe2f573b62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:29.598831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9afc-5b99-498d-89eb-5fe2f573b62c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:29.599107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9afc-5b99-498d-89eb-5fe2f573b62c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:29.599417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9afc-5b99-498d-89eb-5fe2f573b62c None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:29.600612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca9afc-5b99-498d-89eb-5fe2f573b62c None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:29.602075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca9afc-5b99-498d-89eb-5fe2f573b62c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:29.603734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 64/133] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:29 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:29.604585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca9afc-5b99-498d-89eb-5fe2f573b62c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:29.697724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000a8d9-a66b-4739-8741-c0bb8ee15455 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:29.705254 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca9afc-5b99-498d-89eb-5fe2f573b62c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:29.739573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8403f0-6671-4c91-92e9-6e84202c466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:29.740289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8403f0-6671-4c91-92e9-6e84202c466c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:29.740568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8403f0-6671-4c91-92e9-6e84202c466c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:29.740838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8403f0-6671-4c91-92e9-6e84202c466c None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:29.741884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a215f49-329d-48b7-857d-e6d29718db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:29.742377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8403f0-6671-4c91-92e9-6e84202c466c None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:29.742573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215f49-329d-48b7-857d-e6d29718db3f None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:29.742857 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215f49-329d-48b7-857d-e6d29718db3f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:29.743132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215f49-329d-48b7-857d-e6d29718db3f None admin] PATH_INFO: `/v3/projects/cba7cbd512de467591da418cbc118657/users/f7676517cf3c47a0a7ed6087713bb3e8/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:29.743942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8403f0-6671-4c91-92e9-6e84202c466c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:29.745092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a215f49-329d-48b7-857d-e6d29718db3f None admin] RBAC: Authorizing `identity:create_grant(project_id=cba7cbd512de467591da418cbc118657, user_id=f7676517cf3c47a0a7ed6087713bb3e8, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:29.746536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a215f49-329d-48b7-857d-e6d29718db3f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:29.750337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 65/134] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:29 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:29.752132 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf33cb3-f4d3-4a08-8e7f-20c1c3e471ff None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:29.752433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf33cb3-f4d3-4a08-8e7f-20c1c3e471ff None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:29.752686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf33cb3-f4d3-4a08-8e7f-20c1c3e471ff None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:29.754312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 66/135] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:29.755253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf33cb3-f4d3-4a08-8e7f-20c1c3e471ff None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:29.771664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 70/136] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:18:29 2022] PUT /identity/v3/projects/cba7cbd512de467591da418cbc118657/users/f7676517cf3c47a0a7ed6087713bb3e8/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:18:29.775334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a215f49-329d-48b7-857d-e6d29718db3f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:29.817123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:29.869808 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:29.891699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a215f49-329d-48b7-857d-e6d29718db3f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:29.963875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf33cb3-f4d3-4a08-8e7f-20c1c3e471ff None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:29.976367 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c5375-f075-42c5-a2c4-31a8db533fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:29.977405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c5375-f075-42c5-a2c4-31a8db533fb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:29.977879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c5375-f075-42c5-a2c4-31a8db533fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:29.978370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c5375-f075-42c5-a2c4-31a8db533fb6 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/users/f7676517cf3c47a0a7ed6087713bb3e8/roles/35a096ec554741cb99e599760e23fe4d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:29.982453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c5375-f075-42c5-a2c4-31a8db533fb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa5748b82a34c06a18f092a19b0b6c1, user_id=f7676517cf3c47a0a7ed6087713bb3e8, role_id=35a096ec554741cb99e599760e23fe4d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:29.984193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c5375-f075-42c5-a2c4-31a8db533fb6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:30.005150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 71/137] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:18:29 2022] PUT /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/users/f7676517cf3c47a0a7ed6087713bb3e8/roles/35a096ec554741cb99e599760e23fe4d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:18:30.007622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa569bd3-b514-4815-b936-c0d28d7f4230 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:30.010207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa569bd3-b514-4815-b936-c0d28d7f4230 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:30.011139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa569bd3-b514-4815-b936-c0d28d7f4230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:30.019552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab62ade-c867-4500-941d-455cfd0c7545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:30.020656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab62ade-c867-4500-941d-455cfd0c7545 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:30.021233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab62ade-c867-4500-941d-455cfd0c7545 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:30.021702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab62ade-c867-4500-941d-455cfd0c7545 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/users/f7676517cf3c47a0a7ed6087713bb3e8/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:30.026673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab62ade-c867-4500-941d-455cfd0c7545 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa5748b82a34c06a18f092a19b0b6c1, user_id=f7676517cf3c47a0a7ed6087713bb3e8, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:30.030657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab62ade-c867-4500-941d-455cfd0c7545 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:30.046284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aa569bd3-b514-4815-b936-c0d28d7f4230 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:30.048148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aa569bd3-b514-4815-b936-c0d28d7f4230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:30.058064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 67/138] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:18:29 2022] PUT /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/users/f7676517cf3c47a0a7ed6087713bb3e8/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:18:30.150058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 72/139] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:30.435110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee8e1-e10f-4562-a8d3-7bd66dc2904c None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:30.435753 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee8e1-e10f-4562-a8d3-7bd66dc2904c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:30.436241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee8e1-e10f-4562-a8d3-7bd66dc2904c None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:30.437783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 68/140] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:30.444450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5a957-d493-464d-9e96-64a00bbd5a32 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:30.445002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5a957-d493-464d-9e96-64a00bbd5a32 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:30.445464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5a957-d493-464d-9e96-64a00bbd5a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:30.468302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-32e5a957-d493-464d-9e96-64a00bbd5a32 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:30.469881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-32e5a957-d493-464d-9e96-64a00bbd5a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:30.501378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:30.561598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 73/141] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:30.676396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ee8e1-e10f-4562-a8d3-7bd66dc2904c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:30.804970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ee8e1-e10f-4562-a8d3-7bd66dc2904c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:30.831774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:30.851402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90399ef8-c68a-4471-b251-6f4d4e678729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:30.852068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90399ef8-c68a-4471-b251-6f4d4e678729 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:30.852349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90399ef8-c68a-4471-b251-6f4d4e678729 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:30.852625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90399ef8-c68a-4471-b251-6f4d4e678729 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:30.860412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90399ef8-c68a-4471-b251-6f4d4e678729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:30.862635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90399ef8-c68a-4471-b251-6f4d4e678729 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:30.864453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 69/142] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:30.870769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5a957-d493-464d-9e96-64a00bbd5a32 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:31.002866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5a957-d493-464d-9e96-64a00bbd5a32 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:31.042467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b49cd-0749-4f13-83b5-2d3926834a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:31.043085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b49cd-0749-4f13-83b5-2d3926834a1b None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:31.043382 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b49cd-0749-4f13-83b5-2d3926834a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:31.043652 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b49cd-0749-4f13-83b5-2d3926834a1b None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:31.044341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b49cd-0749-4f13-83b5-2d3926834a1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:31.045788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b49cd-0749-4f13-83b5-2d3926834a1b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:31.083249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 74/143] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:18:30 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:31.132997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90399ef8-c68a-4471-b251-6f4d4e678729 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:31.277131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90399ef8-c68a-4471-b251-6f4d4e678729 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:31.329758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4453004-efef-46ff-bb7c-99d9f20bcfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:31.330410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4453004-efef-46ff-bb7c-99d9f20bcfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:31.330682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4453004-efef-46ff-bb7c-99d9f20bcfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:31.330948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4453004-efef-46ff-bb7c-99d9f20bcfe5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:31.352378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4453004-efef-46ff-bb7c-99d9f20bcfe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d4453004-efef-46ff-bb7c-99d9f20bcfe5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:31.357710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:31.358595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:31.359452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 70/144] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:31.366947 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b49cd-0749-4f13-83b5-2d3926834a1b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:31.397496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:31.486909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b49cd-0749-4f13-83b5-2d3926834a1b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:31.522794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd22fb-c380-4bf0-bc1f-7bbbab3d03c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:31.523449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd22fb-c380-4bf0-bc1f-7bbbab3d03c0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:31.523725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd22fb-c380-4bf0-bc1f-7bbbab3d03c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:31.523991 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd22fb-c380-4bf0-bc1f-7bbbab3d03c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:31.524743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd22fb-c380-4bf0-bc1f-7bbbab3d03c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:31.525045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd22fb-c380-4bf0-bc1f-7bbbab3d03c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:31.526447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd22fb-c380-4bf0-bc1f-7bbbab3d03c0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:31.539517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 75/145] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:31.545371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4453004-efef-46ff-bb7c-99d9f20bcfe5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:31.635062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:31.707466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4453004-efef-46ff-bb7c-99d9f20bcfe5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:31.745576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e7a37-0c78-4690-be00-c12c333c5b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:31.746206 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7a37-0c78-4690-be00-c12c333c5b64 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:31.746479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7a37-0c78-4690-be00-c12c333c5b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:31.746745 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7a37-0c78-4690-be00-c12c333c5b64 None admin] PATH_INFO: `/v3/users/3ef679f64c3b42df9f2763c2d3144855` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:31.747891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e7a37-0c78-4690-be00-c12c333c5b64 None admin] RBAC: Authorizing `identity:get_user(user_id=3ef679f64c3b42df9f2763c2d3144855)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:31.749357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e7a37-0c78-4690-be00-c12c333c5b64 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:31.751380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 71/146] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:31 2022] GET /identity/v3/users/3ef679f64c3b42df9f2763c2d3144855 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:31.757000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd22fb-c380-4bf0-bc1f-7bbbab3d03c0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:31.858335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:31.889679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd22fb-c380-4bf0-bc1f-7bbbab3d03c0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:31.930644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779248-1323-40d4-98dd-7221a4474b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:31.931752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779248-1323-40d4-98dd-7221a4474b7a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:31.931752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779248-1323-40d4-98dd-7221a4474b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:31.932032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779248-1323-40d4-98dd-7221a4474b7a None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:31.933301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7779248-1323-40d4-98dd-7221a4474b7a None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:31.934811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7779248-1323-40d4-98dd-7221a4474b7a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:31.936574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 76/147] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:31 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:31.942745 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e7a37-0c78-4690-be00-c12c333c5b64 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:32.002659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4109d9-e4e0-4106-a90f-858e9377b54c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:32.002925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4109d9-e4e0-4106-a90f-858e9377b54c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:32.003261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4109d9-e4e0-4106-a90f-858e9377b54c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:32.004847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 77/148] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:32.014770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc5efb-e7bb-4853-a5f6-9db568aed8fc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:32.015079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc5efb-e7bb-4853-a5f6-9db568aed8fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:32.015334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc5efb-e7bb-4853-a5f6-9db568aed8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:32.048755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c9dc5efb-e7bb-4853-a5f6-9db568aed8fc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:32.050466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c9dc5efb-e7bb-4853-a5f6-9db568aed8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:32.089146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e7a37-0c78-4690-be00-c12c333c5b64 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:32.120873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:32.133418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 78/149] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:32.152670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b953-c6af-4e76-80cd-25d089da85dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:32.153278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b953-c6af-4e76-80cd-25d089da85dd None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:32.153561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b953-c6af-4e76-80cd-25d089da85dd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:32.153828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b953-c6af-4e76-80cd-25d089da85dd None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/users/3ef679f64c3b42df9f2763c2d3144855/roles/3d821a5c8fb04a569b693bc2a5feb1da` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:32.155817 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6b953-c6af-4e76-80cd-25d089da85dd None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa5748b82a34c06a18f092a19b0b6c1, user_id=3ef679f64c3b42df9f2763c2d3144855, role_id=3d821a5c8fb04a569b693bc2a5feb1da)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:32.157338 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6b953-c6af-4e76-80cd-25d089da85dd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:32.174144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 72/150] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:18:31 2022] PUT /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/users/3ef679f64c3b42df9f2763c2d3144855/roles/3d821a5c8fb04a569b693bc2a5feb1da => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:18:32.679214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc5efb-e7bb-4853-a5f6-9db568aed8fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:32.766915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:32.812150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc5efb-e7bb-4853-a5f6-9db568aed8fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:32.855956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5392d7-5011-44ac-825f-d2d7c18b05ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:32.856620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5392d7-5011-44ac-825f-d2d7c18b05ff None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:32.856899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5392d7-5011-44ac-825f-d2d7c18b05ff None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:32.857277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5392d7-5011-44ac-825f-d2d7c18b05ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:32.871755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5392d7-5011-44ac-825f-d2d7c18b05ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1c5392d7-5011-44ac-825f-d2d7c18b05ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:32.877574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:32.878452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:32.879289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 79/151] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:18:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:32.887140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b953-c6af-4e76-80cd-25d089da85dd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:32.906273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11a2d-6964-431f-8cb0-263f011598a5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:32.906600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11a2d-6964-431f-8cb0-263f011598a5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:32.906814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11a2d-6964-431f-8cb0-263f011598a5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:32.908546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 80/152] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:32.918681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936865-e5a5-4816-9057-ad31415f5b49 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:32.919160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936865-e5a5-4816-9057-ad31415f5b49 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:32.919476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936865-e5a5-4816-9057-ad31415f5b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:32.970633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f1936865-e5a5-4816-9057-ad31415f5b49 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:32.971908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f1936865-e5a5-4816-9057-ad31415f5b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:33.118128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b953-c6af-4e76-80cd-25d089da85dd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:33.120681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 81/153] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:33.170883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87503a-d45c-4ffc-9ff2-b13954240065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:33.171530 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87503a-d45c-4ffc-9ff2-b13954240065 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:33.171809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87503a-d45c-4ffc-9ff2-b13954240065 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:33.172074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87503a-d45c-4ffc-9ff2-b13954240065 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:33.172826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87503a-d45c-4ffc-9ff2-b13954240065 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:33.173124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87503a-d45c-4ffc-9ff2-b13954240065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:33.174634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87503a-d45c-4ffc-9ff2-b13954240065 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:33.187098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 73/154] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:33.193192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1936865-e5a5-4816-9057-ad31415f5b49 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:33.287932 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:33.339539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1936865-e5a5-4816-9057-ad31415f5b49 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:33.385251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fea29-d3fc-4198-820f-42bf23cb5605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:33.385901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fea29-d3fc-4198-820f-42bf23cb5605 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:33.386173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fea29-d3fc-4198-820f-42bf23cb5605 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:33.386439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fea29-d3fc-4198-820f-42bf23cb5605 None admin] PATH_INFO: `/v3/users/a648d0c15aec4e95a5b091741686db89` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:33.392048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fea29-d3fc-4198-820f-42bf23cb5605 None admin] RBAC: Authorizing `identity:get_user(user_id=a648d0c15aec4e95a5b091741686db89)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:33.393551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fea29-d3fc-4198-820f-42bf23cb5605 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:33.395377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 82/155] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:33 2022] GET /identity/v3/users/a648d0c15aec4e95a5b091741686db89 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:33.401194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87503a-d45c-4ffc-9ff2-b13954240065 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:33.457066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:33.547132 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87503a-d45c-4ffc-9ff2-b13954240065 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:33.590479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197171e-69a8-4a86-ae57-f3c2ba2cc56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:33.591503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197171e-69a8-4a86-ae57-f3c2ba2cc56d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:33.592030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197171e-69a8-4a86-ae57-f3c2ba2cc56d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:33.592526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197171e-69a8-4a86-ae57-f3c2ba2cc56d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:33.609330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a508d-75ed-409b-bae6-c75f6b6eed2a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:33.609634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a508d-75ed-409b-bae6-c75f6b6eed2a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:33.609885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a508d-75ed-409b-bae6-c75f6b6eed2a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:33.611436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 83/156] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:18:33.618807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b79d83-840d-46fb-b9ca-6d35601f94ac None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:33.619131 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b79d83-840d-46fb-b9ca-6d35601f94ac None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:33.619402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b79d83-840d-46fb-b9ca-6d35601f94ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:33.656445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b9b79d83-840d-46fb-b9ca-6d35601f94ac None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:33.658384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b9b79d83-840d-46fb-b9ca-6d35601f94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:33.708017 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197171e-69a8-4a86-ae57-f3c2ba2cc56d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:33.709952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197171e-69a8-4a86-ae57-f3c2ba2cc56d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:33.795334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:33.806628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 84/157] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:33.878786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 74/158] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:33.884805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b79d83-840d-46fb-b9ca-6d35601f94ac None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:33.908986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197171e-69a8-4a86-ae57-f3c2ba2cc56d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:34.008393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:34.102998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b79d83-840d-46fb-b9ca-6d35601f94ac None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:34.120437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197171e-69a8-4a86-ae57-f3c2ba2cc56d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:34.193368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae224beb-2ff5-499f-b1c2-3f1af1baf5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:34.194008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae224beb-2ff5-499f-b1c2-3f1af1baf5df None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:34.194277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae224beb-2ff5-499f-b1c2-3f1af1baf5df None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:34.194541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae224beb-2ff5-499f-b1c2-3f1af1baf5df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:34.200055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011de35a-b129-4e54-9587-6fb8b6a83991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:34.200723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011de35a-b129-4e54-9587-6fb8b6a83991 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:34.201002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011de35a-b129-4e54-9587-6fb8b6a83991 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:34.201272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011de35a-b129-4e54-9587-6fb8b6a83991 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:34.202481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011de35a-b129-4e54-9587-6fb8b6a83991 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:34.204084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011de35a-b129-4e54-9587-6fb8b6a83991 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:34.204944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:34.206105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 85/159] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:33 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:34.207107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e8c4-193e-44eb-8ea2-dad6b435dd73 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:34.207412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e8c4-193e-44eb-8ea2-dad6b435dd73 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:34.207754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e8c4-193e-44eb-8ea2-dad6b435dd73 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:34.208994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 86/160] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:34.214049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37e8c4-193e-44eb-8ea2-dad6b435dd73 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:34.218679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae224beb-2ff5-499f-b1c2-3f1af1baf5df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ae224beb-2ff5-499f-b1c2-3f1af1baf5df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:34.228334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:34.229337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:34.230096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 75/161] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:34.234544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c00e5-eee0-4d50-9df8-eed27f399af7 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:34.234544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c00e5-eee0-4d50-9df8-eed27f399af7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:34.234544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c00e5-eee0-4d50-9df8-eed27f399af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:34.276349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4d0c00e5-eee0-4d50-9df8-eed27f399af7 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:34.277559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4d0c00e5-eee0-4d50-9df8-eed27f399af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:34.422925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 76/162] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:34.424445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c00e5-eee0-4d50-9df8-eed27f399af7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:34.466357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37e8c4-193e-44eb-8ea2-dad6b435dd73 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:34.526773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:34.546560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a43bc-1ed5-4353-badf-d1b942450707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:34.547180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a43bc-1ed5-4353-badf-d1b942450707 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:34.547480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a43bc-1ed5-4353-badf-d1b942450707 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:34.547913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a43bc-1ed5-4353-badf-d1b942450707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:34.548720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a43bc-1ed5-4353-badf-d1b942450707 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1, user.id=a648d0c15aec4e95a5b091741686db89) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:34.549022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a43bc-1ed5-4353-badf-d1b942450707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:34.550470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a43bc-1ed5-4353-badf-d1b942450707 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:34.562771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 87/163] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:34 2022] GET /identity/v3/role_assignments?user.id=a648d0c15aec4e95a5b091741686db89&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 608 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:34.563770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a43bc-1ed5-4353-badf-d1b942450707 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:34.635158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c00e5-eee0-4d50-9df8-eed27f399af7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:34.686724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:34.709425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4235f0-7fa1-486c-885c-4f81d733f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:34.710058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4235f0-7fa1-486c-885c-4f81d733f320 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:34.710331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4235f0-7fa1-486c-885c-4f81d733f320 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:34.710597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4235f0-7fa1-486c-885c-4f81d733f320 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:34.711281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4235f0-7fa1-486c-885c-4f81d733f320 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:34.711631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4235f0-7fa1-486c-885c-4f81d733f320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:34.713048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4235f0-7fa1-486c-885c-4f81d733f320 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:34.730727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 77/164] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:34.737210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4235f0-7fa1-486c-885c-4f81d733f320 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:34.789357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a43bc-1ed5-4353-badf-d1b942450707 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:34.880126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18957e4f-1179-4d8f-bfcd-b4f55d6f6fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:34.880795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18957e4f-1179-4d8f-bfcd-b4f55d6f6fed None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:34.881048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18957e4f-1179-4d8f-bfcd-b4f55d6f6fed None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:34.881321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18957e4f-1179-4d8f-bfcd-b4f55d6f6fed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:34.905122 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4235f0-7fa1-486c-885c-4f81d733f320 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:34.923977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18957e4f-1179-4d8f-bfcd-b4f55d6f6fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-18957e4f-1179-4d8f-bfcd-b4f55d6f6fed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:34.929345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:34.936098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:34.936924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 88/165] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:18:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:34.939275 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18957e4f-1179-4d8f-bfcd-b4f55d6f6fed None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:34.970157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835ae7c-0b71-43a2-93ee-28e047101f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:34.971516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ae7c-0b71-43a2-93ee-28e047101f51 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:34.972181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ae7c-0b71-43a2-93ee-28e047101f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:34.972637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ae7c-0b71-43a2-93ee-28e047101f51 None admin] PATH_INFO: `/v3/users/f7676517cf3c47a0a7ed6087713bb3e8` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:34.973996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835ae7c-0b71-43a2-93ee-28e047101f51 None admin] RBAC: Authorizing `identity:get_user(user_id=f7676517cf3c47a0a7ed6087713bb3e8)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:34.975737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835ae7c-0b71-43a2-93ee-28e047101f51 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:34.977544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 78/166] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:34 2022] GET /identity/v3/users/f7676517cf3c47a0a7ed6087713bb3e8 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:34.984333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835ae7c-0b71-43a2-93ee-28e047101f51 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:35.053443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:35.070596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:35.110568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835ae7c-0b71-43a2-93ee-28e047101f51 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:35.157202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94716163-ef64-436a-9dc0-2c3e53b48c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:35.158294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94716163-ef64-436a-9dc0-2c3e53b48c33 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:35.158762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94716163-ef64-436a-9dc0-2c3e53b48c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:35.159214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94716163-ef64-436a-9dc0-2c3e53b48c33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:35.181427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18957e4f-1179-4d8f-bfcd-b4f55d6f6fed None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:35.228678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94716163-ef64-436a-9dc0-2c3e53b48c33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:35.230470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94716163-ef64-436a-9dc0-2c3e53b48c33 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:35.274786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787e27-4ec5-4893-a336-88a48479f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:35.275433 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787e27-4ec5-4893-a336-88a48479f804 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:35.275709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787e27-4ec5-4893-a336-88a48479f804 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:35.275975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787e27-4ec5-4893-a336-88a48479f804 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:35.276653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95787e27-4ec5-4893-a336-88a48479f804 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:35.276952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95787e27-4ec5-4893-a336-88a48479f804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:35.278340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95787e27-4ec5-4893-a336-88a48479f804 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:35.298445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 89/167] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:18:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:35.299420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787e27-4ec5-4893-a336-88a48479f804 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:35.315709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:35.383200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 79/168] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 04:18:35.383924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94716163-ef64-436a-9dc0-2c3e53b48c33 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:35.481962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787e27-4ec5-4893-a336-88a48479f804 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:35.504922 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:35.510548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94716163-ef64-436a-9dc0-2c3e53b48c33 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:35.530697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba2ed3-f591-4354-81e3-384c0537bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:35.531369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba2ed3-f591-4354-81e3-384c0537bca7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:35.531652 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba2ed3-f591-4354-81e3-384c0537bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:35.531915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba2ed3-f591-4354-81e3-384c0537bca7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:35.542709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba2ed3-f591-4354-81e3-384c0537bca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-edba2ed3-f591-4354-81e3-384c0537bca7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:35.550519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:35.551462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:35.552260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:35.552855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57951cbb-e3e4-4039-bfda-a790abea8dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:35.552855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57951cbb-e3e4-4039-bfda-a790abea8dce None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:35.553010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 90/169] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:35.553078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57951cbb-e3e4-4039-bfda-a790abea8dce None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:35.553078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57951cbb-e3e4-4039-bfda-a790abea8dce None admin] PATH_INFO: `/v3/users/f7676517cf3c47a0a7ed6087713bb3e8` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:35.553205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba2ed3-f591-4354-81e3-384c0537bca7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:35.554091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57951cbb-e3e4-4039-bfda-a790abea8dce None admin] RBAC: Authorizing `identity:get_user(user_id=f7676517cf3c47a0a7ed6087713bb3e8)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:35.555211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57951cbb-e3e4-4039-bfda-a790abea8dce None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:35.556430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 80/170] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:35 2022] GET /identity/v3/users/f7676517cf3c47a0a7ed6087713bb3e8 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:35.564829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57951cbb-e3e4-4039-bfda-a790abea8dce None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:35.600991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:35.698612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57951cbb-e3e4-4039-bfda-a790abea8dce None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:35.742953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c30744-46c1-4c3d-9881-d814990553bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:35.743513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c30744-46c1-4c3d-9881-d814990553bd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:35.743781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c30744-46c1-4c3d-9881-d814990553bd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:35.744043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c30744-46c1-4c3d-9881-d814990553bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:35.779612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba2ed3-f591-4354-81e3-384c0537bca7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:35.837270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ca3bc-df04-441a-b06b-be8e58d083ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:35.837924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ca3bc-df04-441a-b06b-be8e58d083ff None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:35.838198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ca3bc-df04-441a-b06b-be8e58d083ff None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:35.838465 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ca3bc-df04-441a-b06b-be8e58d083ff None admin] PATH_INFO: `/v3/projects/cba7cbd512de467591da418cbc118657` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:35.844405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ca3bc-df04-441a-b06b-be8e58d083ff None admin] RBAC: Authorizing `identity:get_project(project_id=cba7cbd512de467591da418cbc118657)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:35.846029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ca3bc-df04-441a-b06b-be8e58d083ff None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:35.848277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 91/171] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:35 2022] GET /identity/v3/projects/cba7cbd512de467591da418cbc118657 => generated 312 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:35.849086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ca3bc-df04-441a-b06b-be8e58d083ff None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:35.905328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c30744-46c1-4c3d-9881-d814990553bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:35.907262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c30744-46c1-4c3d-9881-d814990553bd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:35.925369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:35.968786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:36.026711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ca3bc-df04-441a-b06b-be8e58d083ff None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:36.064609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7db1b-73ac-4ac5-abf5-60742cae5875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:36.065374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7db1b-73ac-4ac5-abf5-60742cae5875 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.065648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7db1b-73ac-4ac5-abf5-60742cae5875 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.065956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7db1b-73ac-4ac5-abf5-60742cae5875 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.066643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7db1b-73ac-4ac5-abf5-60742cae5875 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:36.066942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7db1b-73ac-4ac5-abf5-60742cae5875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:36.068608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7db1b-73ac-4ac5-abf5-60742cae5875 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:36.078368 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 92/172] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:36.079180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7db1b-73ac-4ac5-abf5-60742cae5875 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:36.144348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 81/173] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:36.146085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c30744-46c1-4c3d-9881-d814990553bd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:36.195191 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7db1b-73ac-4ac5-abf5-60742cae5875 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:36.203637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:36.235423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a538c-bdc1-424a-9f5a-96a89bb54b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:36.236850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a538c-bdc1-424a-9f5a-96a89bb54b3e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.237133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a538c-bdc1-424a-9f5a-96a89bb54b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.237405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a538c-bdc1-424a-9f5a-96a89bb54b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.238257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a538c-bdc1-424a-9f5a-96a89bb54b3e None admin] RBAC: Adding query filter params (role.id=ec48f4c280dd43db99923e3badf5fe36, scope.project.id=cba7cbd512de467591da418cbc118657, user.id=f7676517cf3c47a0a7ed6087713bb3e8) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:36.238571 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a538c-bdc1-424a-9f5a-96a89bb54b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:36.240120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a538c-bdc1-424a-9f5a-96a89bb54b3e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:36.248078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 93/174] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:36 2022] GET /identity/v3/role_assignments?user.id=f7676517cf3c47a0a7ed6087713bb3e8&scope.project.id=cba7cbd512de467591da418cbc118657&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:36.249665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7a240-f920-40e3-bbb3-4e5ee2df982d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.250279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7a240-f920-40e3-bbb3-4e5ee2df982d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.250558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7a240-f920-40e3-bbb3-4e5ee2df982d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.252970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 94/175] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:36.253626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7a240-f920-40e3-bbb3-4e5ee2df982d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:36.370547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c30744-46c1-4c3d-9881-d814990553bd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:36.389793 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7a240-f920-40e3-bbb3-4e5ee2df982d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:36.397090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:36.409707 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c0573-96dd-4725-9243-597eb9a15084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:36.410285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0573-96dd-4725-9243-597eb9a15084 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.410562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0573-96dd-4725-9243-597eb9a15084 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.410829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0573-96dd-4725-9243-597eb9a15084 None admin] PATH_INFO: `/v3/users/f7676517cf3c47a0a7ed6087713bb3e8` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.412024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c0573-96dd-4725-9243-597eb9a15084 None admin] RBAC: Authorizing `identity:get_user(user_id=f7676517cf3c47a0a7ed6087713bb3e8)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:36.413623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c0573-96dd-4725-9243-597eb9a15084 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:36.415573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 82/176] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:36 2022] GET /identity/v3/users/f7676517cf3c47a0a7ed6087713bb3e8 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:36.416815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f86bed-2451-4875-8868-1aea421cf8b2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.417093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f86bed-2451-4875-8868-1aea421cf8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.417362 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f86bed-2451-4875-8868-1aea421cf8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.435246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b16b2-da11-41d0-883d-56da0b61e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:36.436410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b16b2-da11-41d0-883d-56da0b61e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.436875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b16b2-da11-41d0-883d-56da0b61e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.437230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d7f86bed-2451-4875-8868-1aea421cf8b2 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:36.437554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b16b2-da11-41d0-883d-56da0b61e6f4 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.438606 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d7f86bed-2451-4875-8868-1aea421cf8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:36.439211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b16b2-da11-41d0-883d-56da0b61e6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:36.441242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b16b2-da11-41d0-883d-56da0b61e6f4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:36.444379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 95/177] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:36 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:36.445755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c760e-39bc-4708-8bc2-b9d0e7fae7ec None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.446225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c760e-39bc-4708-8bc2-b9d0e7fae7ec None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.446716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c760e-39bc-4708-8bc2-b9d0e7fae7ec None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.448121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 96/178] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:36.449164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c760e-39bc-4708-8bc2-b9d0e7fae7ec None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:36.497569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:36.545891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 83/179] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:36.547136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f86bed-2451-4875-8868-1aea421cf8b2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:36.575220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c760e-39bc-4708-8bc2-b9d0e7fae7ec None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:36.612338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e142ab-592f-4622-9464-d288e67de55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:36.612954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e142ab-592f-4622-9464-d288e67de55c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.613228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e142ab-592f-4622-9464-d288e67de55c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.613493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e142ab-592f-4622-9464-d288e67de55c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.655995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f86bed-2451-4875-8868-1aea421cf8b2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:36.685760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:36.698976 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e142ab-592f-4622-9464-d288e67de55c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:36.700506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e142ab-592f-4622-9464-d288e67de55c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:36.704988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8e9b9-cd8c-423e-8772-9556584044e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:36.705631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8e9b9-cd8c-423e-8772-9556584044e6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.705905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8e9b9-cd8c-423e-8772-9556584044e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.706173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8e9b9-cd8c-423e-8772-9556584044e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.706916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8e9b9-cd8c-423e-8772-9556584044e6 None admin] RBAC: Adding query filter params (role.id=35a096ec554741cb99e599760e23fe4d, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1, user.id=f7676517cf3c47a0a7ed6087713bb3e8) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:36.707222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8e9b9-cd8c-423e-8772-9556584044e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:36.708733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8e9b9-cd8c-423e-8772-9556584044e6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:36.717118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 84/180] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:36 2022] GET /identity/v3/role_assignments?user.id=f7676517cf3c47a0a7ed6087713bb3e8&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=35a096ec554741cb99e599760e23fe4d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:36.717118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959cfed-4e18-45a1-b4b7-10dd28aac401 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.717118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959cfed-4e18-45a1-b4b7-10dd28aac401 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.717118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959cfed-4e18-45a1-b4b7-10dd28aac401 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.718102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 85/181] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:36.721204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a22d3-fd8b-4793-8162-ea4bc72b4079 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.721741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a22d3-fd8b-4793-8162-ea4bc72b4079 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.722635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a22d3-fd8b-4793-8162-ea4bc72b4079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.748016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-567a22d3-fd8b-4793-8162-ea4bc72b4079 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:36.750449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-567a22d3-fd8b-4793-8162-ea4bc72b4079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:36.754468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:36.846283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 97/182] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:36.847417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526e051-580f-4b67-85eb-88e526bda875 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.847698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526e051-580f-4b67-85eb-88e526bda875 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.847965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526e051-580f-4b67-85eb-88e526bda875 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.848635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 86/183] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:36.849242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 98/184] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:36.850324 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca6c83-a01a-4ad2-8ea6-dac2802b8207 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.850793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca6c83-a01a-4ad2-8ea6-dac2802b8207 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.851259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca6c83-a01a-4ad2-8ea6-dac2802b8207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.854187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526e051-580f-4b67-85eb-88e526bda875 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:36.876658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c2ca6c83-a01a-4ad2-8ea6-dac2802b8207 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:36.878227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c2ca6c83-a01a-4ad2-8ea6-dac2802b8207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:36.962138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 87/185] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:36.963233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93999fe8-06a0-4d02-a431-815d98f67b60 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:36.963696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93999fe8-06a0-4d02-a431-815d98f67b60 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:36.963935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93999fe8-06a0-4d02-a431-815d98f67b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:36.979709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526e051-580f-4b67-85eb-88e526bda875 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:36.983082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-93999fe8-06a0-4d02-a431-815d98f67b60 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:36.991627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-93999fe8-06a0-4d02-a431-815d98f67b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:37.024406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77ee2-df28-4c33-8ec9-15fbad10d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.025897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77ee2-df28-4c33-8ec9-15fbad10d674 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.026176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77ee2-df28-4c33-8ec9-15fbad10d674 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.026444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77ee2-df28-4c33-8ec9-15fbad10d674 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.027603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77ee2-df28-4c33-8ec9-15fbad10d674 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:37.035620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77ee2-df28-4c33-8ec9-15fbad10d674 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:37.038113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 99/186] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:36 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:37.038894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77ee2-df28-4c33-8ec9-15fbad10d674 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.039440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:37.043105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:37.077598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 88/187] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:37.078453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93999fe8-06a0-4d02-a431-815d98f67b60 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.170533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77ee2-df28-4c33-8ec9-15fbad10d674 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:37.214101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd39b-7c7e-42ef-817d-811679599ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.214336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93999fe8-06a0-4d02-a431-815d98f67b60 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:37.215842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd39b-7c7e-42ef-817d-811679599ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.217192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd39b-7c7e-42ef-817d-811679599ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.217689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd39b-7c7e-42ef-817d-811679599ec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.230881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd39b-7c7e-42ef-817d-811679599ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ea2fd39b-7c7e-42ef-817d-811679599ec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:37.238731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:37.239646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:37.240455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 100/188] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:37.241119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd39b-7c7e-42ef-817d-811679599ec2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.257259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e298ab6-e07c-4d16-9624-de0cb8f002ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.257696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e298ab6-e07c-4d16-9624-de0cb8f002ec None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.258028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e298ab6-e07c-4d16-9624-de0cb8f002ec None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.258364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e298ab6-e07c-4d16-9624-de0cb8f002ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.259283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e298ab6-e07c-4d16-9624-de0cb8f002ec None admin] RBAC: Adding query filter params (role.id=ec48f4c280dd43db99923e3badf5fe36, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1, user.id=f7676517cf3c47a0a7ed6087713bb3e8) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:37.259671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e298ab6-e07c-4d16-9624-de0cb8f002ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:37.261226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e298ab6-e07c-4d16-9624-de0cb8f002ec None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:37.267711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 89/189] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/role_assignments?user.id=f7676517cf3c47a0a7ed6087713bb3e8&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:37.274237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e298ab6-e07c-4d16-9624-de0cb8f002ec None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.333209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:37.345992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:37.394338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd39b-7c7e-42ef-817d-811679599ec2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:37.402371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e298ab6-e07c-4d16-9624-de0cb8f002ec None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:37.430549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdeb99-886f-483f-8388-51de2be004d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.431111 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdeb99-886f-483f-8388-51de2be004d1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.431420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdeb99-886f-483f-8388-51de2be004d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.431686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdeb99-886f-483f-8388-51de2be004d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.443259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdeb99-886f-483f-8388-51de2be004d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:37.444732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31838708-254c-4b01-a4d7-d85551ffffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.445554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31838708-254c-4b01-a4d7-d85551ffffce None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.446005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31838708-254c-4b01-a4d7-d85551ffffce None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.446477 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31838708-254c-4b01-a4d7-d85551ffffce None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.447385 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31838708-254c-4b01-a4d7-d85551ffffce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:37.447860 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31838708-254c-4b01-a4d7-d85551ffffce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6afdeb99-886f-483f-8388-51de2be004d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:37.448804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:37.449687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:37.450468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 101/190] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:37.451125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31838708-254c-4b01-a4d7-d85551ffffce None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:37.455846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdeb99-886f-483f-8388-51de2be004d1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.461454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 90/191] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:37.462400 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31838708-254c-4b01-a4d7-d85551ffffce None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.577624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdeb99-886f-483f-8388-51de2be004d1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:37.579848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31838708-254c-4b01-a4d7-d85551ffffce None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:37.581386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:37.601912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:37.613290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc6264-8413-4378-98cf-df939680dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.613515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733f405-c7c1-4d02-8942-d57143016749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.613929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc6264-8413-4378-98cf-df939680dfdc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.614143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733f405-c7c1-4d02-8942-d57143016749 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.614233 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc6264-8413-4378-98cf-df939680dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.614412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733f405-c7c1-4d02-8942-d57143016749 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.614501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc6264-8413-4378-98cf-df939680dfdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.614676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733f405-c7c1-4d02-8942-d57143016749 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.615593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc6264-8413-4378-98cf-df939680dfdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:37.617384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc6264-8413-4378-98cf-df939680dfdc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:37.618956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 102/192] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:37.619742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc6264-8413-4378-98cf-df939680dfdc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.628273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733f405-c7c1-4d02-8942-d57143016749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-8733f405-c7c1-4d02-8942-d57143016749 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:37.633539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:37.634404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 91/193] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:37.636064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733f405-c7c1-4d02-8942-d57143016749 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.725682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc6264-8413-4378-98cf-df939680dfdc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:37.734266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733f405-c7c1-4d02-8942-d57143016749 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:37.759586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06be8e-85da-402e-94e2-9173f8019f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.760195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06be8e-85da-402e-94e2-9173f8019f76 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.760471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06be8e-85da-402e-94e2-9173f8019f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.760769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06be8e-85da-402e-94e2-9173f8019f76 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.761440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06be8e-85da-402e-94e2-9173f8019f76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:37.761741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06be8e-85da-402e-94e2-9173f8019f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:37.763129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06be8e-85da-402e-94e2-9173f8019f76 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:37.768092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27db906-56bd-4ce2-9b3d-35771f4b77b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.768727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27db906-56bd-4ce2-9b3d-35771f4b77b8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.768996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27db906-56bd-4ce2-9b3d-35771f4b77b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.769260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27db906-56bd-4ce2-9b3d-35771f4b77b8 None admin] PATH_INFO: `/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.771654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 103/194] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:37.772464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06be8e-85da-402e-94e2-9173f8019f76 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.784173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27db906-56bd-4ce2-9b3d-35771f4b77b8 None admin] RBAC: Authorizing `identity:get_user(user_id=f36b7318f26d4a2a8e98719fe0c1dc8c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:37.785654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27db906-56bd-4ce2-9b3d-35771f4b77b8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:37.787331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 92/195] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:37.788102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27db906-56bd-4ce2-9b3d-35771f4b77b8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.810505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:37.832554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:37.876700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06be8e-85da-402e-94e2-9173f8019f76 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:37.886395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27db906-56bd-4ce2-9b3d-35771f4b77b8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:37.908622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c050d-f72d-4590-898c-c43d5ad8ece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.909236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c050d-f72d-4590-898c-c43d5ad8ece4 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.909513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c050d-f72d-4590-898c-c43d5ad8ece4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.909780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c050d-f72d-4590-898c-c43d5ad8ece4 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.910441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c050d-f72d-4590-898c-c43d5ad8ece4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:37.911928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c050d-f72d-4590-898c-c43d5ad8ece4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:37.919518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732b91b-136f-4961-b9d7-479700716057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:37.920139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732b91b-136f-4961-b9d7-479700716057 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:37.920411 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732b91b-136f-4961-b9d7-479700716057 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:37.920684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732b91b-136f-4961-b9d7-479700716057 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:37.921386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732b91b-136f-4961-b9d7-479700716057 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:37.921680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732b91b-136f-4961-b9d7-479700716057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:37.923101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732b91b-136f-4961-b9d7-479700716057 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:37.932515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 93/196] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:37.933353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732b91b-136f-4961-b9d7-479700716057 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:37.938238 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 104/197] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:18:37 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:37.939200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c050d-f72d-4590-898c-c43d5ad8ece4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:38.026348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:38.046671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732b91b-136f-4961-b9d7-479700716057 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:38.063257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c050d-f72d-4590-898c-c43d5ad8ece4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:38.076020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:38.082671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4c018-b8e5-46d3-a09d-7a3a00567f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:38.083483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4c018-b8e5-46d3-a09d-7a3a00567f47 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:38.083787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4c018-b8e5-46d3-a09d-7a3a00567f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:38.084055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4c018-b8e5-46d3-a09d-7a3a00567f47 None admin] PATH_INFO: `/v3/users/3ef679f64c3b42df9f2763c2d3144855` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:38.085267 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4c018-b8e5-46d3-a09d-7a3a00567f47 None admin] RBAC: Authorizing `identity:get_user(user_id=3ef679f64c3b42df9f2763c2d3144855)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:38.086735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4c018-b8e5-46d3-a09d-7a3a00567f47 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:38.088645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 94/198] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/users/3ef679f64c3b42df9f2763c2d3144855 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:38.089251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4c018-b8e5-46d3-a09d-7a3a00567f47 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:38.108757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98ee0e-fa26-4586-b842-72890dc9c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:38.109699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98ee0e-fa26-4586-b842-72890dc9c05a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:38.110214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98ee0e-fa26-4586-b842-72890dc9c05a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:38.110485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98ee0e-fa26-4586-b842-72890dc9c05a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:38.195488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98ee0e-fa26-4586-b842-72890dc9c05a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:38.197275 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98ee0e-fa26-4586-b842-72890dc9c05a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:38.214436 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4c018-b8e5-46d3-a09d-7a3a00567f47 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:38.263497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64543-0ee0-466b-8767-73a6293fdab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:38.264141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64543-0ee0-466b-8767-73a6293fdab6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:38.264413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64543-0ee0-466b-8767-73a6293fdab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:38.264679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64543-0ee0-466b-8767-73a6293fdab6 None admin] PATH_INFO: `/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:38.265834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f64543-0ee0-466b-8767-73a6293fdab6 None admin] RBAC: Authorizing `identity:get_user(user_id=f36b7318f26d4a2a8e98719fe0c1dc8c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:38.267564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f64543-0ee0-466b-8767-73a6293fdab6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:38.269164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 95/199] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:38 2022] GET /identity/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:38.269948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64543-0ee0-466b-8767-73a6293fdab6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:38.290760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:38.324585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 105/200] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:38.325853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98ee0e-fa26-4586-b842-72890dc9c05a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:38.341304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:38.387272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64543-0ee0-466b-8767-73a6293fdab6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:38.421260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a5e30-c57a-45ce-8268-f26cc7235c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:38.421881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a5e30-c57a-45ce-8268-f26cc7235c47 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:38.422154 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a5e30-c57a-45ce-8268-f26cc7235c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:38.422420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a5e30-c57a-45ce-8268-f26cc7235c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:38.434116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98ee0e-fa26-4586-b842-72890dc9c05a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:38.469202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b59b-036b-48dd-9469-39188d3427b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:38.470260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b59b-036b-48dd-9469-39188d3427b0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:38.470703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b59b-036b-48dd-9469-39188d3427b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:38.471175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b59b-036b-48dd-9469-39188d3427b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:38.492091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a5e30-c57a-45ce-8268-f26cc7235c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:38.493624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a5e30-c57a-45ce-8268-f26cc7235c47 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:38.512211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:38.545546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8b59b-036b-48dd-9469-39188d3427b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:38.547343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8b59b-036b-48dd-9469-39188d3427b0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:38.562053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:38.596147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 96/201] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:38.596966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a5e30-c57a-45ce-8268-f26cc7235c47 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:38.660938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 106/202] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:38.662159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b59b-036b-48dd-9469-39188d3427b0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:38.717252 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a5e30-c57a-45ce-8268-f26cc7235c47 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:38.739822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:38.757412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f77b4e-6293-42e3-a815-e5ef2a60b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:38.758060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f77b4e-6293-42e3-a815-e5ef2a60b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:38.758335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f77b4e-6293-42e3-a815-e5ef2a60b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:38.758604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f77b4e-6293-42e3-a815-e5ef2a60b5b1 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:38.759906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f77b4e-6293-42e3-a815-e5ef2a60b5b1 None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:38.761401 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f77b4e-6293-42e3-a815-e5ef2a60b5b1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:38.763050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 97/203] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:38 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:38.763975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f77b4e-6293-42e3-a815-e5ef2a60b5b1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:38.787111 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b59b-036b-48dd-9469-39188d3427b0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:38.799602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:38.826372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0f503-3923-486a-a6ba-c5d69b5af1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:38.827490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0f503-3923-486a-a6ba-c5d69b5af1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:38.828046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0f503-3923-486a-a6ba-c5d69b5af1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:38.828555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0f503-3923-486a-a6ba-c5d69b5af1d7 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:38.829983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0f503-3923-486a-a6ba-c5d69b5af1d7 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:38.831826 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0f503-3923-486a-a6ba-c5d69b5af1d7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:38.834083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 107/204] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:38 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:38.835041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0f503-3923-486a-a6ba-c5d69b5af1d7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:38.869141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f77b4e-6293-42e3-a815-e5ef2a60b5b1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:38.903539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b076d8d-15c3-4796-a0b4-2c577e0bd110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:38.904172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b076d8d-15c3-4796-a0b4-2c577e0bd110 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:38.904460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b076d8d-15c3-4796-a0b4-2c577e0bd110 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:38.904719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b076d8d-15c3-4796-a0b4-2c577e0bd110 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:38.905840 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b076d8d-15c3-4796-a0b4-2c577e0bd110 None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:38.907445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b076d8d-15c3-4796-a0b4-2c577e0bd110 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:38.909104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 98/205] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:38 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:38.914689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b076d8d-15c3-4796-a0b4-2c577e0bd110 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:38.946796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0f503-3923-486a-a6ba-c5d69b5af1d7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:38.973274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:38.988072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8b877-d887-4fed-8113-f90eb70ebe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:38.989161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8b877-d887-4fed-8113-f90eb70ebe75 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:38.989738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8b877-d887-4fed-8113-f90eb70ebe75 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:38.990193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8b877-d887-4fed-8113-f90eb70ebe75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:38.991120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8b877-d887-4fed-8113-f90eb70ebe75 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=3d2568887e324450bce4edcbb25b94bb, user.id=f36b7318f26d4a2a8e98719fe0c1dc8c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:38.991987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8b877-d887-4fed-8113-f90eb70ebe75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:38.993674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8b877-d887-4fed-8113-f90eb70ebe75 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:39.000050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 108/206] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:38 2022] GET /identity/v3/role_assignments?user.id=f36b7318f26d4a2a8e98719fe0c1dc8c&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:39.001256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8b877-d887-4fed-8113-f90eb70ebe75 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:39.021961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b076d8d-15c3-4796-a0b4-2c577e0bd110 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:39.052650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:39.058455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cc4f8-e981-425e-a959-c1504c83b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:39.059001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cc4f8-e981-425e-a959-c1504c83b74b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:39.059279 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cc4f8-e981-425e-a959-c1504c83b74b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:39.059572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cc4f8-e981-425e-a959-c1504c83b74b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:39.060453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cc4f8-e981-425e-a959-c1504c83b74b None admin] RBAC: Adding query filter params (role.id=3d821a5c8fb04a569b693bc2a5feb1da, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1, user.id=3ef679f64c3b42df9f2763c2d3144855) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:39.060762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cc4f8-e981-425e-a959-c1504c83b74b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:39.062271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cc4f8-e981-425e-a959-c1504c83b74b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:39.069255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 99/207] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:38 2022] GET /identity/v3/role_assignments?user.id=3ef679f64c3b42df9f2763c2d3144855&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=3d821a5c8fb04a569b693bc2a5feb1da => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:39.126245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8b877-d887-4fed-8113-f90eb70ebe75 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:39.167738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585cd80-bc19-4148-ab6a-4f4c59371da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:39.168794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585cd80-bc19-4148-ab6a-4f4c59371da0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:39.169264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585cd80-bc19-4148-ab6a-4f4c59371da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:39.169724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585cd80-bc19-4148-ab6a-4f4c59371da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:39.170780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585cd80-bc19-4148-ab6a-4f4c59371da0 None admin] RBAC: Adding query filter params (role.id=35a096ec554741cb99e599760e23fe4d, scope.project.id=3d2568887e324450bce4edcbb25b94bb, user.id=f36b7318f26d4a2a8e98719fe0c1dc8c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:39.171393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585cd80-bc19-4148-ab6a-4f4c59371da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:39.173439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585cd80-bc19-4148-ab6a-4f4c59371da0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:39.180829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 109/208] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:39 2022] GET /identity/v3/role_assignments?user.id=f36b7318f26d4a2a8e98719fe0c1dc8c&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=35a096ec554741cb99e599760e23fe4d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:40.263399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1e8d6-570e-440e-990f-3428dbfb7ee0 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:40.263926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1e8d6-570e-440e-990f-3428dbfb7ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:40.263926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1e8d6-570e-440e-990f-3428dbfb7ee0 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:40.265585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 100/209] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:40.271028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da90ec-a19f-4627-96c3-338d1e0f5294 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:40.271447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da90ec-a19f-4627-96c3-338d1e0f5294 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:40.271608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da90ec-a19f-4627-96c3-338d1e0f5294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:40.290357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-42da90ec-a19f-4627-96c3-338d1e0f5294 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:40.291597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-42da90ec-a19f-4627-96c3-338d1e0f5294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:40.365727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 110/210] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:40.476431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249dd13-65f1-4776-b205-051551a0bce3 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:40.476785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249dd13-65f1-4776-b205-051551a0bce3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:40.476979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249dd13-65f1-4776-b205-051551a0bce3 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:40.478624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 101/211] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:40.484820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d3375-51fc-4c2e-9f46-216463144609 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:40.485274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d3375-51fc-4c2e-9f46-216463144609 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:40.485666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d3375-51fc-4c2e-9f46-216463144609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:40.505066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9e6d3375-51fc-4c2e-9f46-216463144609 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:40.506259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9e6d3375-51fc-4c2e-9f46-216463144609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:40.536601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:40.581461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 111/212] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:40.631023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249dd13-65f1-4776-b205-051551a0bce3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:40.734673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249dd13-65f1-4776-b205-051551a0bce3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:40.752566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:40.769680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd77cb-da7d-4542-8237-2b9a4d1c97fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:40.770332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd77cb-da7d-4542-8237-2b9a4d1c97fb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:40.770607 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd77cb-da7d-4542-8237-2b9a4d1c97fb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:40.770871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd77cb-da7d-4542-8237-2b9a4d1c97fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:40.781626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd77cb-da7d-4542-8237-2b9a4d1c97fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-67bd77cb-da7d-4542-8237-2b9a4d1c97fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:40.786684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:40.787592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:40.788394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 102/213] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:40.794047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d3375-51fc-4c2e-9f46-216463144609 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:40.853255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd77cb-da7d-4542-8237-2b9a4d1c97fb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:40.899624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d3375-51fc-4c2e-9f46-216463144609 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:40.950241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343edf7a-5886-473c-b3dc-065b52ce7013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:40.950851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343edf7a-5886-473c-b3dc-065b52ce7013 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:40.951127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343edf7a-5886-473c-b3dc-065b52ce7013 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:40.951415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343edf7a-5886-473c-b3dc-065b52ce7013 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:40.952194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343edf7a-5886-473c-b3dc-065b52ce7013 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:40.952492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343edf7a-5886-473c-b3dc-065b52ce7013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:40.954022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343edf7a-5886-473c-b3dc-065b52ce7013 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:40.964782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 112/214] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:40.964932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd77cb-da7d-4542-8237-2b9a4d1c97fb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:40.970619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343edf7a-5886-473c-b3dc-065b52ce7013 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:41.003334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:41.003523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6d1c4-8865-4ecc-ab90-abed2030106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:41.004771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6d1c4-8865-4ecc-ab90-abed2030106d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:41.005097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6d1c4-8865-4ecc-ab90-abed2030106d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:41.005373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6d1c4-8865-4ecc-ab90-abed2030106d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:41.006516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6d1c4-8865-4ecc-ab90-abed2030106d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:41.008016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6d1c4-8865-4ecc-ab90-abed2030106d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:41.009962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 103/215] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:41.020601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6d1c4-8865-4ecc-ab90-abed2030106d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:41.080994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343edf7a-5886-473c-b3dc-065b52ce7013 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:41.082793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:41.119352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadae17e-a4ce-4560-93a5-29557ae6efb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:41.120414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadae17e-a4ce-4560-93a5-29557ae6efb0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:41.120896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadae17e-a4ce-4560-93a5-29557ae6efb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:41.121308 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadae17e-a4ce-4560-93a5-29557ae6efb0 None admin] PATH_INFO: `/v3/users/a9b56277c02f4a43b6ac4cba032de082` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:41.136416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadae17e-a4ce-4560-93a5-29557ae6efb0 None admin] RBAC: Authorizing `identity:get_user(user_id=a9b56277c02f4a43b6ac4cba032de082)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:41.138167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadae17e-a4ce-4560-93a5-29557ae6efb0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:41.140120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 113/216] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:40 2022] GET /identity/v3/users/a9b56277c02f4a43b6ac4cba032de082 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:41.146333 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadae17e-a4ce-4560-93a5-29557ae6efb0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:41.160626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6d1c4-8865-4ecc-ab90-abed2030106d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:41.205240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3435e-251b-4903-b768-5e78c6277425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:41.206771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3435e-251b-4903-b768-5e78c6277425 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:41.207221 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3435e-251b-4903-b768-5e78c6277425 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:41.207933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3435e-251b-4903-b768-5e78c6277425 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:41.208985 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3435e-251b-4903-b768-5e78c6277425 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:41.211414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3435e-251b-4903-b768-5e78c6277425 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:41.240406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:41.243154 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 104/217] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:18:41 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:41.264890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadae17e-a4ce-4560-93a5-29557ae6efb0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:41.311720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db558e5c-310b-4179-9ab3-a07891dcf6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:41.313337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db558e5c-310b-4179-9ab3-a07891dcf6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:41.313837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db558e5c-310b-4179-9ab3-a07891dcf6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:41.314408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db558e5c-310b-4179-9ab3-a07891dcf6e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:41.438083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db558e5c-310b-4179-9ab3-a07891dcf6e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:41.439943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db558e5c-310b-4179-9ab3-a07891dcf6e3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:41.476925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d0026-5e7e-48ad-b678-a5a6b88e9b3f None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:41.477453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d0026-5e7e-48ad-b678-a5a6b88e9b3f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:41.477453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d0026-5e7e-48ad-b678-a5a6b88e9b3f None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:41.478813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 105/218] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:41.484601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a181a8-176c-4b4c-b6e6-a2949b944b32 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:41.485653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a181a8-176c-4b4c-b6e6-a2949b944b32 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:41.486125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a181a8-176c-4b4c-b6e6-a2949b944b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:41.518855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-32a181a8-176c-4b4c-b6e6-a2949b944b32 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:41.520651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-32a181a8-176c-4b4c-b6e6-a2949b944b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:41.553662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:41.573874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 114/219] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:41.579792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9870f74-2546-42a1-9059-b9a0a54fcc17 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:41.580360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9870f74-2546-42a1-9059-b9a0a54fcc17 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:41.581713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9870f74-2546-42a1-9059-b9a0a54fcc17 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:41.585161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 115/220] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:41.586144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9870f74-2546-42a1-9059-b9a0a54fcc17 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:41.628250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 106/221] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:41.632179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344011-1f67-4964-835d-176ba43b8487 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:41.632456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344011-1f67-4964-835d-176ba43b8487 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:41.632718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344011-1f67-4964-835d-176ba43b8487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:41.658712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6d344011-1f67-4964-835d-176ba43b8487 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:41.661434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6d344011-1f67-4964-835d-176ba43b8487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:41.705399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:41.780209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 107/222] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:41.781522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9870f74-2546-42a1-9059-b9a0a54fcc17 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:41.826487 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65b91c-8291-4c32-8430-409dc430cefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:41.827145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65b91c-8291-4c32-8430-409dc430cefa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:41.827462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65b91c-8291-4c32-8430-409dc430cefa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:41.827716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65b91c-8291-4c32-8430-409dc430cefa None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:41.832068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65b91c-8291-4c32-8430-409dc430cefa None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:41.833560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65b91c-8291-4c32-8430-409dc430cefa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:41.835274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 116/223] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:41 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:41.842562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344011-1f67-4964-835d-176ba43b8487 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:41.978254 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344011-1f67-4964-835d-176ba43b8487 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:42.024113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd90ed-b43c-40c9-bb37-309a1a1103d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:42.024734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd90ed-b43c-40c9-bb37-309a1a1103d0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:42.025005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd90ed-b43c-40c9-bb37-309a1a1103d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:42.025272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd90ed-b43c-40c9-bb37-309a1a1103d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:42.026013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd90ed-b43c-40c9-bb37-309a1a1103d0 None admin] RBAC: Adding query filter params (role.id=ec48f4c280dd43db99923e3badf5fe36, scope.project.id=3d2568887e324450bce4edcbb25b94bb, user.id=a9b56277c02f4a43b6ac4cba032de082) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:42.026317 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd90ed-b43c-40c9-bb37-309a1a1103d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:42.027804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd90ed-b43c-40c9-bb37-309a1a1103d0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:42.033488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 108/224] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:41 2022] GET /identity/v3/role_assignments?user.id=a9b56277c02f4a43b6ac4cba032de082&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:42.092848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65b91c-8291-4c32-8430-409dc430cefa None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:42.093402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd90ed-b43c-40c9-bb37-309a1a1103d0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:42.124435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:42.193417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:42.277102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd90ed-b43c-40c9-bb37-309a1a1103d0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:42.278679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65b91c-8291-4c32-8430-409dc430cefa None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:42.317553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad56d9-d955-4fdd-b96d-2ba2e8e68a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:42.318879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad56d9-d955-4fdd-b96d-2ba2e8e68a0c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:42.319381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad56d9-d955-4fdd-b96d-2ba2e8e68a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:42.319839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad56d9-d955-4fdd-b96d-2ba2e8e68a0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:42.323426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697342fb-8fe2-4954-8efe-3c54270a5ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:42.324255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697342fb-8fe2-4954-8efe-3c54270a5ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:42.324674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697342fb-8fe2-4954-8efe-3c54270a5ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:42.325149 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697342fb-8fe2-4954-8efe-3c54270a5ef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:42.336736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697342fb-8fe2-4954-8efe-3c54270a5ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-697342fb-8fe2-4954-8efe-3c54270a5ef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:42.342724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:42.343672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:42.344679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:42.347465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 109/225] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:18:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:42.354659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697342fb-8fe2-4954-8efe-3c54270a5ef8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:42.356570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad56d9-d955-4fdd-b96d-2ba2e8e68a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-39ad56d9-d955-4fdd-b96d-2ba2e8e68a0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:42.364651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:42.365587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:42.366769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:42.370261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 117/226] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:18:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:42.378086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad56d9-d955-4fdd-b96d-2ba2e8e68a0c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:42.493203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad56d9-d955-4fdd-b96d-2ba2e8e68a0c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:42.509674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:42.533908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defb2ba-2cfc-47f3-8146-8e213752c181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:42.534878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defb2ba-2cfc-47f3-8146-8e213752c181 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:42.535401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defb2ba-2cfc-47f3-8146-8e213752c181 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:42.535868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defb2ba-2cfc-47f3-8146-8e213752c181 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:42.537324 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defb2ba-2cfc-47f3-8146-8e213752c181 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:42.537835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defb2ba-2cfc-47f3-8146-8e213752c181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:42.539665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defb2ba-2cfc-47f3-8146-8e213752c181 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:42.555264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 118/227] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:18:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:42.557217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defb2ba-2cfc-47f3-8146-8e213752c181 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:42.612854 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:42.649426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697342fb-8fe2-4954-8efe-3c54270a5ef8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:42.673895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defb2ba-2cfc-47f3-8146-8e213752c181 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:42.711023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd31d0b-3fac-472b-b328-6c0abc9c019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:42.712182 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31d0b-3fac-472b-b328-6c0abc9c019a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:42.712658 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31d0b-3fac-472b-b328-6c0abc9c019a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:42.713126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31d0b-3fac-472b-b328-6c0abc9c019a None admin] PATH_INFO: `/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:42.714468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd31d0b-3fac-472b-b328-6c0abc9c019a None admin] RBAC: Authorizing `identity:get_user(user_id=f36b7318f26d4a2a8e98719fe0c1dc8c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:42.716461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd31d0b-3fac-472b-b328-6c0abc9c019a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:42.723146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 119/228] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:42 2022] GET /identity/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:42.724981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd31d0b-3fac-472b-b328-6c0abc9c019a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:42.756012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13014ce-3db5-450b-8c3d-184760b39304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:42.756643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13014ce-3db5-450b-8c3d-184760b39304 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:42.756921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13014ce-3db5-450b-8c3d-184760b39304 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:42.757188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13014ce-3db5-450b-8c3d-184760b39304 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:42.757872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13014ce-3db5-450b-8c3d-184760b39304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:42.758173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13014ce-3db5-450b-8c3d-184760b39304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:42.759589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13014ce-3db5-450b-8c3d-184760b39304 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:42.779000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:42.781480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 110/229] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:42.786926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13014ce-3db5-450b-8c3d-184760b39304 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:42.834178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd31d0b-3fac-472b-b328-6c0abc9c019a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:42.870949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620920de-8e2a-4544-a262-7df560b2f70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:42.872140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620920de-8e2a-4544-a262-7df560b2f70d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:42.872619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620920de-8e2a-4544-a262-7df560b2f70d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:42.873091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620920de-8e2a-4544-a262-7df560b2f70d None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:42.874427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620920de-8e2a-4544-a262-7df560b2f70d None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:42.876147 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620920de-8e2a-4544-a262-7df560b2f70d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:42.883208 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 120/230] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:42 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:42.885152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620920de-8e2a-4544-a262-7df560b2f70d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:42.999562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620920de-8e2a-4544-a262-7df560b2f70d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:43.027691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:43.043591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518d601-72e0-4209-9241-ec89d4aceb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:43.043591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518d601-72e0-4209-9241-ec89d4aceb32 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:43.043591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518d601-72e0-4209-9241-ec89d4aceb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:43.043591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518d601-72e0-4209-9241-ec89d4aceb32 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb/users/f36b7318f26d4a2a8e98719fe0c1dc8c/roles/35a096ec554741cb99e599760e23fe4d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:43.048459 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518d601-72e0-4209-9241-ec89d4aceb32 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d2568887e324450bce4edcbb25b94bb, user_id=f36b7318f26d4a2a8e98719fe0c1dc8c, role_id=35a096ec554741cb99e599760e23fe4d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:43.050082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518d601-72e0-4209-9241-ec89d4aceb32 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:43.075458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 121/231] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:18:42 2022] PUT /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb/users/f36b7318f26d4a2a8e98719fe0c1dc8c/roles/35a096ec554741cb99e599760e23fe4d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:18:43.088005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13014ce-3db5-450b-8c3d-184760b39304 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:43.139611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665625-fa82-4640-a19c-2fef13aca398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:43.140271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665625-fa82-4640-a19c-2fef13aca398 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:43.140549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665625-fa82-4640-a19c-2fef13aca398 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:43.140821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665625-fa82-4640-a19c-2fef13aca398 None admin] PATH_INFO: `/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:43.142595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665625-fa82-4640-a19c-2fef13aca398 None admin] RBAC: Authorizing `identity:get_user(user_id=f36b7318f26d4a2a8e98719fe0c1dc8c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:43.144178 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665625-fa82-4640-a19c-2fef13aca398 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:43.145896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 111/232] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:42 2022] GET /identity/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c => generated 283 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:43.151785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518d601-72e0-4209-9241-ec89d4aceb32 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:43.265356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518d601-72e0-4209-9241-ec89d4aceb32 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:43.306531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515de5f2-518b-4223-9dbc-963de91afb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:43.306531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515de5f2-518b-4223-9dbc-963de91afb7e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:43.306531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515de5f2-518b-4223-9dbc-963de91afb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:43.306531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515de5f2-518b-4223-9dbc-963de91afb7e None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:43.307075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515de5f2-518b-4223-9dbc-963de91afb7e None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:43.309588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515de5f2-518b-4223-9dbc-963de91afb7e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:43.311629 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 122/233] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:43 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:43.319871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665625-fa82-4640-a19c-2fef13aca398 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:43.355751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:43.468234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665625-fa82-4640-a19c-2fef13aca398 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:43.515604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba80f21-65bd-41df-ab3a-45f0ab57693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:43.516378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80f21-65bd-41df-ab3a-45f0ab57693e None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:43.516660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80f21-65bd-41df-ab3a-45f0ab57693e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:43.516936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80f21-65bd-41df-ab3a-45f0ab57693e None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb/users/f36b7318f26d4a2a8e98719fe0c1dc8c/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:43.518931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba80f21-65bd-41df-ab3a-45f0ab57693e None admin] RBAC: Authorizing `identity:create_grant(project_id=3d2568887e324450bce4edcbb25b94bb, user_id=f36b7318f26d4a2a8e98719fe0c1dc8c, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:43.520535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba80f21-65bd-41df-ab3a-45f0ab57693e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:43.540065 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 112/234] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:18:43 2022] PUT /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb/users/f36b7318f26d4a2a8e98719fe0c1dc8c/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:18:43.984075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1f041-98a4-4038-acc1-4c03db79a145 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:43.985335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1f041-98a4-4038-acc1-4c03db79a145 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:43.985863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1f041-98a4-4038-acc1-4c03db79a145 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:43.987873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 123/235] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:43.994612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801a84e-ca55-4229-8eef-1c9f818b1058 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:43.995602 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801a84e-ca55-4229-8eef-1c9f818b1058 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:43.996090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801a84e-ca55-4229-8eef-1c9f818b1058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:44.025902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a801a84e-ca55-4229-8eef-1c9f818b1058 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:44.027477 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a801a84e-ca55-4229-8eef-1c9f818b1058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:44.092930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64a44d-4440-455c-ab63-8ad0d635c0d5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:44.093546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64a44d-4440-455c-ab63-8ad0d635c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:44.094032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64a44d-4440-455c-ab63-8ad0d635c0d5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:44.095716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 124/236] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:18:44.104751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d00774-e4c0-4b8b-bf35-9586cfc9661b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:44.105226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d00774-e4c0-4b8b-bf35-9586cfc9661b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:44.105684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d00774-e4c0-4b8b-bf35-9586cfc9661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:44.114582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 113/237] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:44.125152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a2d00774-e4c0-4b8b-bf35-9586cfc9661b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:44.126674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a2d00774-e4c0-4b8b-bf35-9586cfc9661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:44.171560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:44.217843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 125/238] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:44.456516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801a84e-ca55-4229-8eef-1c9f818b1058 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:44.465312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:44.503196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d00774-e4c0-4b8b-bf35-9586cfc9661b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:44.567052 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801a84e-ca55-4229-8eef-1c9f818b1058 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:44.603425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a465d-872d-434c-bc55-757049eedaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:44.604347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a465d-872d-434c-bc55-757049eedaaf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:44.604763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a465d-872d-434c-bc55-757049eedaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:44.605273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a465d-872d-434c-bc55-757049eedaaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:44.620040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a465d-872d-434c-bc55-757049eedaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-689a465d-872d-434c-bc55-757049eedaaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:44.625414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:44.626567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:44.627564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:44.629994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 114/239] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:44.631582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486d23-10e8-43a1-bc71-5d01187d9a71 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:44.632005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486d23-10e8-43a1-bc71-5d01187d9a71 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:44.632412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486d23-10e8-43a1-bc71-5d01187d9a71 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:44.633841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 115/240] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:44.638676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486d23-10e8-43a1-bc71-5d01187d9a71 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:44.664780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d00774-e4c0-4b8b-bf35-9586cfc9661b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:44.708504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2f4a3-9c38-46e4-b6c4-ec88a80baab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:44.709390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2f4a3-9c38-46e4-b6c4-ec88a80baab2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:44.709814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2f4a3-9c38-46e4-b6c4-ec88a80baab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:44.710244 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2f4a3-9c38-46e4-b6c4-ec88a80baab2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:44.710999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:44.712033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2f4a3-9c38-46e4-b6c4-ec88a80baab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:44.713721 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2f4a3-9c38-46e4-b6c4-ec88a80baab2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:44.715536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 126/241] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:44.717962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8f684-7a87-47bf-9713-83cdd4924206 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:44.718398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8f684-7a87-47bf-9713-83cdd4924206 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:44.718808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8f684-7a87-47bf-9713-83cdd4924206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:44.738755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-eff8f684-7a87-47bf-9713-83cdd4924206 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:44.740491 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eff8f684-7a87-47bf-9713-83cdd4924206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:44.760232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486d23-10e8-43a1-bc71-5d01187d9a71 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:44.781103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:44.806226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4922d-b716-4fc9-8e30-927679671282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:44.807154 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4922d-b716-4fc9-8e30-927679671282 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:44.807663 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4922d-b716-4fc9-8e30-927679671282 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:44.808145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4922d-b716-4fc9-8e30-927679671282 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:44.809015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4922d-b716-4fc9-8e30-927679671282 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:44.809559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4922d-b716-4fc9-8e30-927679671282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:44.811150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4922d-b716-4fc9-8e30-927679671282 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:44.821104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 116/242] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:44.822486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4922d-b716-4fc9-8e30-927679671282 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:44.824775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 127/243] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:44.826940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8f684-7a87-47bf-9713-83cdd4924206 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:44.981175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8f684-7a87-47bf-9713-83cdd4924206 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:45.007356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4922d-b716-4fc9-8e30-927679671282 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:45.048748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:45.049996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf4bc-6ef7-4d51-9655-cba6cd0ab5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:45.050651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf4bc-6ef7-4d51-9655-cba6cd0ab5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:45.050925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf4bc-6ef7-4d51-9655-cba6cd0ab5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:45.051195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf4bc-6ef7-4d51-9655-cba6cd0ab5c0 None admin] PATH_INFO: `/v3/users/6ab73aa4f17744f98ef7a5a0aa59e0dc` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:45.053025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fee77e-297a-4672-86ae-21154d261a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:45.055629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fee77e-297a-4672-86ae-21154d261a58 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:45.055629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fee77e-297a-4672-86ae-21154d261a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:45.055629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fee77e-297a-4672-86ae-21154d261a58 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:45.055629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fee77e-297a-4672-86ae-21154d261a58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:45.057174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fee77e-297a-4672-86ae-21154d261a58 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:45.071021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bf4bc-6ef7-4d51-9655-cba6cd0ab5c0 None admin] RBAC: Authorizing `identity:get_user(user_id=6ab73aa4f17744f98ef7a5a0aa59e0dc)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:45.072779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bf4bc-6ef7-4d51-9655-cba6cd0ab5c0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:45.074560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 128/244] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:44 2022] GET /identity/v3/users/6ab73aa4f17744f98ef7a5a0aa59e0dc => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:45.080468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf4bc-6ef7-4d51-9655-cba6cd0ab5c0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:45.119768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:45.126340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 117/245] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:18:44 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:45.155933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fee77e-297a-4672-86ae-21154d261a58 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:45.194078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf4bc-6ef7-4d51-9655-cba6cd0ab5c0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:45.236984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057d4aa-be7d-4552-b914-dc145a9c56df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:45.237911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057d4aa-be7d-4552-b914-dc145a9c56df None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:45.238355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057d4aa-be7d-4552-b914-dc145a9c56df None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:45.238947 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057d4aa-be7d-4552-b914-dc145a9c56df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:45.335865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057d4aa-be7d-4552-b914-dc145a9c56df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:45.337782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057d4aa-be7d-4552-b914-dc145a9c56df None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:45.379688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:45.388245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fee77e-297a-4672-86ae-21154d261a58 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:45.434616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396d226-e7b5-4c7e-bb46-b0b52778546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:45.435512 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396d226-e7b5-4c7e-bb46-b0b52778546c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:45.435907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396d226-e7b5-4c7e-bb46-b0b52778546c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:45.436258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396d226-e7b5-4c7e-bb46-b0b52778546c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:45.448440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396d226-e7b5-4c7e-bb46-b0b52778546c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4396d226-e7b5-4c7e-bb46-b0b52778546c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:45.454588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:45.455645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:45.456638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:45.458294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 118/246] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:45.464093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396d226-e7b5-4c7e-bb46-b0b52778546c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:45.464305 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 129/247] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:45.471356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057d4aa-be7d-4552-b914-dc145a9c56df None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:45.518681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:45.600020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057d4aa-be7d-4552-b914-dc145a9c56df None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:45.600380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396d226-e7b5-4c7e-bb46-b0b52778546c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:45.641812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:45.643795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b9340-c931-474d-acc2-75942cef0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:45.644557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b9340-c931-474d-acc2-75942cef0364 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:45.644928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b9340-c931-474d-acc2-75942cef0364 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:45.645291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b9340-c931-474d-acc2-75942cef0364 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:45.646113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b9340-c931-474d-acc2-75942cef0364 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:45.646513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b9340-c931-474d-acc2-75942cef0364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:45.649679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b9340-c931-474d-acc2-75942cef0364 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:45.652545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dee5aa-7bb1-4116-9b49-a054abeebe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:45.653819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee5aa-7bb1-4116-9b49-a054abeebe94 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:45.654277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee5aa-7bb1-4116-9b49-a054abeebe94 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:45.654796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee5aa-7bb1-4116-9b49-a054abeebe94 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:45.656949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dee5aa-7bb1-4116-9b49-a054abeebe94 None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:45.658941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dee5aa-7bb1-4116-9b49-a054abeebe94 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:45.660435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 119/248] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:45.661173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 130/249] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:45 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:45.666067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b9340-c931-474d-acc2-75942cef0364 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:45.667395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dee5aa-7bb1-4116-9b49-a054abeebe94 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:45.802959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b9340-c931-474d-acc2-75942cef0364 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:45.807923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dee5aa-7bb1-4116-9b49-a054abeebe94 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:45.810765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:45.850947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fec2a0-1c65-4674-b2c2-31cf91019245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:45.851987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fec2a0-1c65-4674-b2c2-31cf91019245 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:45.852366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fec2a0-1c65-4674-b2c2-31cf91019245 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:45.852732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fec2a0-1c65-4674-b2c2-31cf91019245 None admin] PATH_INFO: `/v3/users/a9b56277c02f4a43b6ac4cba032de082` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:45.853979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fec2a0-1c65-4674-b2c2-31cf91019245 None admin] RBAC: Authorizing `identity:get_user(user_id=a9b56277c02f4a43b6ac4cba032de082)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:45.855577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fec2a0-1c65-4674-b2c2-31cf91019245 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:45.856472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df704-14d6-4d0e-b291-20619549bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:45.857241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df704-14d6-4d0e-b291-20619549bc23 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:45.857655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df704-14d6-4d0e-b291-20619549bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:45.857758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 120/250] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:45 2022] GET /identity/v3/users/a9b56277c02f4a43b6ac4cba032de082 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:45.858197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df704-14d6-4d0e-b291-20619549bc23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:45.859221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df704-14d6-4d0e-b291-20619549bc23 None admin] RBAC: Adding query filter params (role.id=3d821a5c8fb04a569b693bc2a5feb1da, scope.project.id=3d2568887e324450bce4edcbb25b94bb, user.id=6ab73aa4f17744f98ef7a5a0aa59e0dc) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:45.860771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df704-14d6-4d0e-b291-20619549bc23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:45.862393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df704-14d6-4d0e-b291-20619549bc23 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:45.863743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fec2a0-1c65-4674-b2c2-31cf91019245 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:45.870245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 131/251] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:45 2022] GET /identity/v3/role_assignments?user.id=6ab73aa4f17744f98ef7a5a0aa59e0dc&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=3d821a5c8fb04a569b693bc2a5feb1da => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:45.984603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fec2a0-1c65-4674-b2c2-31cf91019245 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:46.022675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc664a1b-e978-473a-ac2f-d5790b055217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:46.023457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc664a1b-e978-473a-ac2f-d5790b055217 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:46.023643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc664a1b-e978-473a-ac2f-d5790b055217 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:46.023900 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc664a1b-e978-473a-ac2f-d5790b055217 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:46.025027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc664a1b-e978-473a-ac2f-d5790b055217 None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:46.026510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc664a1b-e978-473a-ac2f-d5790b055217 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:46.028203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 121/252] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:45 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:46.034225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df704-14d6-4d0e-b291-20619549bc23 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:46.074819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6340664-1a35-4acd-ba9f-35763ed89f5c None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:46.075142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6340664-1a35-4acd-ba9f-35763ed89f5c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:46.075386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6340664-1a35-4acd-ba9f-35763ed89f5c None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:46.077130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 122/253] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:46.089461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac42e1-9aff-433d-83c0-fa9b0a97d456 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:46.089792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac42e1-9aff-433d-83c0-fa9b0a97d456 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:46.090007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac42e1-9aff-433d-83c0-fa9b0a97d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:46.105640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:46.115527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-08ac42e1-9aff-433d-83c0-fa9b0a97d456 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:46.117763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-08ac42e1-9aff-433d-83c0-fa9b0a97d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:46.153362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df704-14d6-4d0e-b291-20619549bc23 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:46.170144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:46.192471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1e10e-5711-4c5f-b382-96b637a863bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:46.193561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1e10e-5711-4c5f-b382-96b637a863bd None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:46.194045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1e10e-5711-4c5f-b382-96b637a863bd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:46.194511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1e10e-5711-4c5f-b382-96b637a863bd None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb/users/a9b56277c02f4a43b6ac4cba032de082/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:46.196897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1e10e-5711-4c5f-b382-96b637a863bd None admin] RBAC: Authorizing `identity:create_grant(project_id=3d2568887e324450bce4edcbb25b94bb, user_id=a9b56277c02f4a43b6ac4cba032de082, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:46.198618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1e10e-5711-4c5f-b382-96b637a863bd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:46.209341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 123/254] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:46.215522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 132/255] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:18:46 2022] PUT /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb/users/a9b56277c02f4a43b6ac4cba032de082/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:18:46.421825 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50444c9-197c-4083-ad16-5cd76c6b9172 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:46.422012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50444c9-197c-4083-ad16-5cd76c6b9172 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:46.422280 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50444c9-197c-4083-ad16-5cd76c6b9172 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:46.424005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 124/256] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:46.429340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a2b84-3358-4257-9fba-c9882915da3c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:46.429624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a2b84-3358-4257-9fba-c9882915da3c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:46.429885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a2b84-3358-4257-9fba-c9882915da3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:46.452644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6c9a2b84-3358-4257-9fba-c9882915da3c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:46.456591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6c9a2b84-3358-4257-9fba-c9882915da3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:46.527297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 133/257] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:46.605051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50444c9-197c-4083-ad16-5cd76c6b9172 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:46.732701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50444c9-197c-4083-ad16-5cd76c6b9172 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:46.768370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8674977-5f02-4bb8-9a4c-62be59f0af66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:46.769012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8674977-5f02-4bb8-9a4c-62be59f0af66 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:46.769287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8674977-5f02-4bb8-9a4c-62be59f0af66 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:46.769550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8674977-5f02-4bb8-9a4c-62be59f0af66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:46.780302 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8674977-5f02-4bb8-9a4c-62be59f0af66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f8674977-5f02-4bb8-9a4c-62be59f0af66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:46.785504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:46.786439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:46.787672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 125/258] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:18:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:46.796660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a2b84-3358-4257-9fba-c9882915da3c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:46.844002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8674977-5f02-4bb8-9a4c-62be59f0af66 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:46.879800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:46.901991 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:46.984520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8674977-5f02-4bb8-9a4c-62be59f0af66 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:47.020377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a2b84-3358-4257-9fba-c9882915da3c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:47.041540 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad7f0c-1b95-44ad-abe2-0c1628b039ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:47.042201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7f0c-1b95-44ad-abe2-0c1628b039ef None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:47.042452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7f0c-1b95-44ad-abe2-0c1628b039ef None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:47.042721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7f0c-1b95-44ad-abe2-0c1628b039ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:47.067724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad7f0c-1b95-44ad-abe2-0c1628b039ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4fad7f0c-1b95-44ad-abe2-0c1628b039ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:47.072954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:47.073838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:47.075057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 126/259] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:47.082101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e019228-51eb-479f-bcdb-70b973540745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:47.082498 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad7f0c-1b95-44ad-abe2-0c1628b039ef None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:47.082723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e019228-51eb-479f-bcdb-70b973540745 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:47.082997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e019228-51eb-479f-bcdb-70b973540745 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:47.083262 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e019228-51eb-479f-bcdb-70b973540745 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:47.083966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e019228-51eb-479f-bcdb-70b973540745 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:47.084263 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e019228-51eb-479f-bcdb-70b973540745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:47.085638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e019228-51eb-479f-bcdb-70b973540745 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:47.103141 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 134/260] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:18:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:47.108451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e019228-51eb-479f-bcdb-70b973540745 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:47.249115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:47.252779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad7f0c-1b95-44ad-abe2-0c1628b039ef None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:47.289681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e019228-51eb-479f-bcdb-70b973540745 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:47.321061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:47.334904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc5ed-dccb-46fc-9b97-d8cadb52d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:47.335558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc5ed-dccb-46fc-9b97-d8cadb52d4ca None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:47.335836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc5ed-dccb-46fc-9b97-d8cadb52d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:47.336102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc5ed-dccb-46fc-9b97-d8cadb52d4ca None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:47.336776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffc5ed-dccb-46fc-9b97-d8cadb52d4ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:47.337070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffc5ed-dccb-46fc-9b97-d8cadb52d4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:47.338476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffc5ed-dccb-46fc-9b97-d8cadb52d4ca None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:47.358852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 127/261] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:47.363330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a56c9-4cc7-405b-b1fa-a9308932795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:47.363330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a56c9-4cc7-405b-b1fa-a9308932795b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:47.363330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a56c9-4cc7-405b-b1fa-a9308932795b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:47.363330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a56c9-4cc7-405b-b1fa-a9308932795b None admin] PATH_INFO: `/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:47.363630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a56c9-4cc7-405b-b1fa-a9308932795b None admin] RBAC: Authorizing `identity:get_user(user_id=f36b7318f26d4a2a8e98719fe0c1dc8c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:47.363630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a56c9-4cc7-405b-b1fa-a9308932795b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:47.365025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 135/262] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:47 2022] GET /identity/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:47.370848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a56c9-4cc7-405b-b1fa-a9308932795b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:47.371182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc5ed-dccb-46fc-9b97-d8cadb52d4ca None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:47.472901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a56c9-4cc7-405b-b1fa-a9308932795b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:47.506198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c33f6-1d59-4752-82e1-d77b4c375b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:47.506729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c33f6-1d59-4752-82e1-d77b4c375b36 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:47.507002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c33f6-1d59-4752-82e1-d77b4c375b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:47.507266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c33f6-1d59-4752-82e1-d77b4c375b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:47.554862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:47.574381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c33f6-1d59-4752-82e1-d77b4c375b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:47.576194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c33f6-1d59-4752-82e1-d77b4c375b36 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:47.636368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc5ed-dccb-46fc-9b97-d8cadb52d4ca None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:47.679197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 136/263] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:47.688865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c33f6-1d59-4752-82e1-d77b4c375b36 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:47.752074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786f8ef-389f-493e-8084-531154e8fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:47.752998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786f8ef-389f-493e-8084-531154e8fecf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:47.753420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786f8ef-389f-493e-8084-531154e8fecf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:47.753832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786f8ef-389f-493e-8084-531154e8fecf None admin] PATH_INFO: `/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:47.760104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786f8ef-389f-493e-8084-531154e8fecf None admin] RBAC: Authorizing `identity:get_user(user_id=f36b7318f26d4a2a8e98719fe0c1dc8c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:47.761836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786f8ef-389f-493e-8084-531154e8fecf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:47.764068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 128/264] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:47 2022] GET /identity/v3/users/f36b7318f26d4a2a8e98719fe0c1dc8c => generated 283 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:47.788390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786f8ef-389f-493e-8084-531154e8fecf None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:47.797088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:47.825372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c33f6-1d59-4752-82e1-d77b4c375b36 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:47.868953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:47.882420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52211dff-3549-4c64-a50f-32ddf6d9317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:47.883446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52211dff-3549-4c64-a50f-32ddf6d9317b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:47.883915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52211dff-3549-4c64-a50f-32ddf6d9317b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:47.884369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52211dff-3549-4c64-a50f-32ddf6d9317b None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:47.885709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52211dff-3549-4c64-a50f-32ddf6d9317b None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:47.887413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52211dff-3549-4c64-a50f-32ddf6d9317b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:47.889733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 137/265] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:47 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:47.895959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52211dff-3549-4c64-a50f-32ddf6d9317b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:48.036974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52211dff-3549-4c64-a50f-32ddf6d9317b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:48.050252 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786f8ef-389f-493e-8084-531154e8fecf None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:48.072178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d04ca-c496-4e66-92ff-7b6210bf6521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:48.073134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d04ca-c496-4e66-92ff-7b6210bf6521 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:48.073643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d04ca-c496-4e66-92ff-7b6210bf6521 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:48.074117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d04ca-c496-4e66-92ff-7b6210bf6521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:48.075049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d04ca-c496-4e66-92ff-7b6210bf6521 None admin] RBAC: Adding query filter params (role.id=35a096ec554741cb99e599760e23fe4d, scope.project.id=3d2568887e324450bce4edcbb25b94bb, user.id=f36b7318f26d4a2a8e98719fe0c1dc8c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:48.075570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d04ca-c496-4e66-92ff-7b6210bf6521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:48.077188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d04ca-c496-4e66-92ff-7b6210bf6521 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:48.083888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 138/266] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:47 2022] GET /identity/v3/role_assignments?user.id=f36b7318f26d4a2a8e98719fe0c1dc8c&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=35a096ec554741cb99e599760e23fe4d => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:48.117797 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c85bbb-90e6-4ad9-a081-0d95b6549e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:48.118440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c85bbb-90e6-4ad9-a081-0d95b6549e3a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:48.118720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c85bbb-90e6-4ad9-a081-0d95b6549e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:48.118991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c85bbb-90e6-4ad9-a081-0d95b6549e3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:48.222095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c85bbb-90e6-4ad9-a081-0d95b6549e3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:48.223633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c85bbb-90e6-4ad9-a081-0d95b6549e3a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:48.258734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:48.382620 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 129/267] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:48.388317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d04ca-c496-4e66-92ff-7b6210bf6521 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:48.404403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:48.503766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d04ca-c496-4e66-92ff-7b6210bf6521 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:48.537566 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb799a1f-1feb-4558-9f10-c5a6930af9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:48.538482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb799a1f-1feb-4558-9f10-c5a6930af9ff None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:48.538906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb799a1f-1feb-4558-9f10-c5a6930af9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:48.539340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb799a1f-1feb-4558-9f10-c5a6930af9ff None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:48.540589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb799a1f-1feb-4558-9f10-c5a6930af9ff None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:48.542197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb799a1f-1feb-4558-9f10-c5a6930af9ff None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:48.544296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 139/268] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:48 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:48.550466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c85bbb-90e6-4ad9-a081-0d95b6549e3a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:48.671374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c85bbb-90e6-4ad9-a081-0d95b6549e3a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:48.695234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:48.715750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a1d19-d84a-46bc-bf03-a3f2799c81b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:48.716667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1d19-d84a-46bc-bf03-a3f2799c81b5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:48.717094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1d19-d84a-46bc-bf03-a3f2799c81b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:48.717511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1d19-d84a-46bc-bf03-a3f2799c81b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:48.718394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a1d19-d84a-46bc-bf03-a3f2799c81b5 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=3d2568887e324450bce4edcbb25b94bb, user.id=f36b7318f26d4a2a8e98719fe0c1dc8c) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:48.718868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a1d19-d84a-46bc-bf03-a3f2799c81b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:48.720867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a1d19-d84a-46bc-bf03-a3f2799c81b5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:48.732526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 130/269] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:48 2022] GET /identity/v3/role_assignments?user.id=f36b7318f26d4a2a8e98719fe0c1dc8c&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:48.839564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8386f4-3574-4a63-91cf-f05ea481154b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:48.840073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8386f4-3574-4a63-91cf-f05ea481154b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:48.840546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8386f4-3574-4a63-91cf-f05ea481154b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:48.842391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 140/270] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:48.848020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f387a0e-297e-4103-8dbf-508ae4142277 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:48.848612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f387a0e-297e-4103-8dbf-508ae4142277 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:48.849076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f387a0e-297e-4103-8dbf-508ae4142277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:48.876659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7f387a0e-297e-4103-8dbf-508ae4142277 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:48.878278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7f387a0e-297e-4103-8dbf-508ae4142277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:48.961910 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 131/271] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:49.084418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb4020-13d4-478e-8a16-11d240464a95 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.084806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb4020-13d4-478e-8a16-11d240464a95 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.084985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb4020-13d4-478e-8a16-11d240464a95 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.086458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 141/272] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:49.092091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765655-5b3e-4658-8915-43a0e7efbfc1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.092539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765655-5b3e-4658-8915-43a0e7efbfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.092614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765655-5b3e-4658-8915-43a0e7efbfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.111330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f3765655-5b3e-4658-8915-43a0e7efbfc1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:49.112862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f3765655-5b3e-4658-8915-43a0e7efbfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:49.145145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb136977-65eb-4f84-94ac-7e14b7113b0c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.145457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb136977-65eb-4f84-94ac-7e14b7113b0c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.145702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb136977-65eb-4f84-94ac-7e14b7113b0c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.147051 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 142/273] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:49.152315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8cd56-baa8-49ee-a939-f01c0ea4fc5e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.152604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8cd56-baa8-49ee-a939-f01c0ea4fc5e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.152873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8cd56-baa8-49ee-a939-f01c0ea4fc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.188242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-82a8cd56-baa8-49ee-a939-f01c0ea4fc5e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:49.189869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-82a8cd56-baa8-49ee-a939-f01c0ea4fc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:49.192667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 132/274] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:49.273794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 143/275] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:49.298890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3765655-5b3e-4658-8915-43a0e7efbfc1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:49.363848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:49.419121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3765655-5b3e-4658-8915-43a0e7efbfc1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:49.455452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c069936-82d4-4ae9-86fb-b938965026dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:49.456106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069936-82d4-4ae9-86fb-b938965026dd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.456376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069936-82d4-4ae9-86fb-b938965026dd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.456640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069936-82d4-4ae9-86fb-b938965026dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.468715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c069936-82d4-4ae9-86fb-b938965026dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:49.472653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8cd56-baa8-49ee-a939-f01c0ea4fc5e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6c069936-82d4-4ae9-86fb-b938965026dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:49.474273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:49.475323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:49.476161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 133/276] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:49.484453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c069936-82d4-4ae9-86fb-b938965026dd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:49.488349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:49.589943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8cd56-baa8-49ee-a939-f01c0ea4fc5e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:49.602923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c069936-82d4-4ae9-86fb-b938965026dd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:49.610168 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:49.623819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50f189-8aff-40db-ab76-393da01aaccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:49.624464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50f189-8aff-40db-ab76-393da01aaccb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.624728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50f189-8aff-40db-ab76-393da01aaccb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.624997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50f189-8aff-40db-ab76-393da01aaccb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.626287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50f189-8aff-40db-ab76-393da01aaccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:49.627784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50f189-8aff-40db-ab76-393da01aaccb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:49.629367 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 144/277] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:49.634756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50f189-8aff-40db-ab76-393da01aaccb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:49.636951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad40e0-9160-4b5d-9852-848f3e7de719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:49.637641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad40e0-9160-4b5d-9852-848f3e7de719 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.637984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad40e0-9160-4b5d-9852-848f3e7de719 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.638264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad40e0-9160-4b5d-9852-848f3e7de719 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.638934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad40e0-9160-4b5d-9852-848f3e7de719 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:49.639238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad40e0-9160-4b5d-9852-848f3e7de719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:49.640656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad40e0-9160-4b5d-9852-848f3e7de719 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:49.649030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 134/278] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:49.650933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28df9c-5083-4076-beae-c9d3cb414d13 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.651212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28df9c-5083-4076-beae-c9d3cb414d13 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.651510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28df9c-5083-4076-beae-c9d3cb414d13 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.652732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 135/279] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:49.656039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28df9c-5083-4076-beae-c9d3cb414d13 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:49.718478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:49.741621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50f189-8aff-40db-ab76-393da01aaccb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:49.755463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28df9c-5083-4076-beae-c9d3cb414d13 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:49.773868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9fafe-3843-4297-83c3-e7e42bdff1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:49.774536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9fafe-3843-4297-83c3-e7e42bdff1bf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.774802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9fafe-3843-4297-83c3-e7e42bdff1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.775070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9fafe-3843-4297-83c3-e7e42bdff1bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.785067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9fafe-3843-4297-83c3-e7e42bdff1bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:49.789347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7a6fc-02b2-46b8-9e9d-f5459a1f2cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-34d9fafe-3843-4297-83c3-e7e42bdff1bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:49.789874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:49.790800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:49.791960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:49.792758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7a6fc-02b2-46b8-9e9d-f5459a1f2cc0 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.792758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7a6fc-02b2-46b8-9e9d-f5459a1f2cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.792758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7a6fc-02b2-46b8-9e9d-f5459a1f2cc0 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.792934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 145/280] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:49.793000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7a6fc-02b2-46b8-9e9d-f5459a1f2cc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:49.793064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9fafe-3843-4297-83c3-e7e42bdff1bf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:49.793138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7a6fc-02b2-46b8-9e9d-f5459a1f2cc0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:49.814947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 136/281] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:18:49 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:49.816296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6c12e-9382-4706-bd3f-1fa3fb35c7f8 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.816574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6c12e-9382-4706-bd3f-1fa3fb35c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.816839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6c12e-9382-4706-bd3f-1fa3fb35c7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.836066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-98a6c12e-9382-4706-bd3f-1fa3fb35c7f8 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:49.837331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-98a6c12e-9382-4706-bd3f-1fa3fb35c7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:49.857604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:49.915359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9fafe-3843-4297-83c3-e7e42bdff1bf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:49.927380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 137/282] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:49.927380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6c12e-9382-4706-bd3f-1fa3fb35c7f8 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:49.970067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3e13f-3ba3-4244-9491-6b018c771c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:49.970988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3e13f-3ba3-4244-9491-6b018c771c05 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:49.971493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3e13f-3ba3-4244-9491-6b018c771c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:49.971856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3e13f-3ba3-4244-9491-6b018c771c05 None admin] PATH_INFO: `/v3/users/768a4d7e4b0a4686bab4c462a886b231` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:49.976464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:49.990067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3e13f-3ba3-4244-9491-6b018c771c05 None admin] RBAC: Authorizing `identity:get_user(user_id=768a4d7e4b0a4686bab4c462a886b231)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:49.992170 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3e13f-3ba3-4244-9491-6b018c771c05 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:49.994153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 146/283] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:49 2022] GET /identity/v3/users/768a4d7e4b0a4686bab4c462a886b231 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:50.000014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3e13f-3ba3-4244-9491-6b018c771c05 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:50.050231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6c12e-9382-4706-bd3f-1fa3fb35c7f8 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:50.094349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04613fa8-2b4e-4fe6-86d8-9eea3737a44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:50.095921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04613fa8-2b4e-4fe6-86d8-9eea3737a44d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:50.096438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04613fa8-2b4e-4fe6-86d8-9eea3737a44d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:50.096924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04613fa8-2b4e-4fe6-86d8-9eea3737a44d None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:50.097813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04613fa8-2b4e-4fe6-86d8-9eea3737a44d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:50.098187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04613fa8-2b4e-4fe6-86d8-9eea3737a44d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:50.099867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04613fa8-2b4e-4fe6-86d8-9eea3737a44d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:50.108770 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 138/284] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:50.115006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04613fa8-2b4e-4fe6-86d8-9eea3737a44d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:50.126666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3e13f-3ba3-4244-9491-6b018c771c05 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:50.137574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:50.171138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a35f2-8e0e-462d-bae6-5ccbb1414bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:50.171626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a35f2-8e0e-462d-bae6-5ccbb1414bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:50.171902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a35f2-8e0e-462d-bae6-5ccbb1414bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:50.172168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a35f2-8e0e-462d-bae6-5ccbb1414bc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:50.172943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a35f2-8e0e-462d-bae6-5ccbb1414bc5 None admin] RBAC: Adding query filter params (role.id=ec48f4c280dd43db99923e3badf5fe36, user.id=768a4d7e4b0a4686bab4c462a886b231, scope.system=all) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:50.173330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a35f2-8e0e-462d-bae6-5ccbb1414bc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:50.174770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a35f2-8e0e-462d-bae6-5ccbb1414bc5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:50.181247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 147/285] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Oct 6 04:18:49 2022] GET /identity/v3/role_assignments?user.id=768a4d7e4b0a4686bab4c462a886b231&scope.system=all&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:50.215071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a35f2-8e0e-462d-bae6-5ccbb1414bc5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:50.243037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04613fa8-2b4e-4fe6-86d8-9eea3737a44d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:50.294841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6df61e-6620-4846-aa8a-1ad1d2589a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:50.296026 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df61e-6620-4846-aa8a-1ad1d2589a4e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:50.296511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df61e-6620-4846-aa8a-1ad1d2589a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:50.297003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df61e-6620-4846-aa8a-1ad1d2589a4e None admin] PATH_INFO: `/v3/users/6ab73aa4f17744f98ef7a5a0aa59e0dc` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:50.298268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:50.299823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6df61e-6620-4846-aa8a-1ad1d2589a4e None admin] RBAC: Authorizing `identity:get_user(user_id=6ab73aa4f17744f98ef7a5a0aa59e0dc)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:50.301780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6df61e-6620-4846-aa8a-1ad1d2589a4e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:50.308645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 139/286] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:50 2022] GET /identity/v3/users/6ab73aa4f17744f98ef7a5a0aa59e0dc => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:50.314836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6df61e-6620-4846-aa8a-1ad1d2589a4e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:50.377614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a35f2-8e0e-462d-bae6-5ccbb1414bc5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:50.422226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12e732-ac17-44af-8013-2ccaac01e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:50.422938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e732-ac17-44af-8013-2ccaac01e75e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:50.423354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e732-ac17-44af-8013-2ccaac01e75e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:50.423542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e732-ac17-44af-8013-2ccaac01e75e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:50.460435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12e732-ac17-44af-8013-2ccaac01e75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-af12e732-ac17-44af-8013-2ccaac01e75e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:50.465618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:50.466514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:50.467299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:50.474539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 148/287] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:50.479100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12e732-ac17-44af-8013-2ccaac01e75e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:50.483671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:50.512486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6df61e-6620-4846-aa8a-1ad1d2589a4e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:50.546611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4052601-3853-4689-a01c-087970365f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:50.547282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4052601-3853-4689-a01c-087970365f32 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:50.547611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4052601-3853-4689-a01c-087970365f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:50.547883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4052601-3853-4689-a01c-087970365f32 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:50.549002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4052601-3853-4689-a01c-087970365f32 None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:50.550486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4052601-3853-4689-a01c-087970365f32 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:50.552207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 140/288] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:50 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:50.560360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4052601-3853-4689-a01c-087970365f32 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:50.694759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12e732-ac17-44af-8013-2ccaac01e75e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:50.727432 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4052601-3853-4689-a01c-087970365f32 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:50.737298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:50.763439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4c3cd-a7c9-4732-9154-13a22fa4d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:50.764056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4c3cd-a7c9-4732-9154-13a22fa4d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:50.764350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4c3cd-a7c9-4732-9154-13a22fa4d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:50.764587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4c3cd-a7c9-4732-9154-13a22fa4d0e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:50.765267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4c3cd-a7c9-4732-9154-13a22fa4d0e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:50.765563 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4c3cd-a7c9-4732-9154-13a22fa4d0e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:50.767213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4c3cd-a7c9-4732-9154-13a22fa4d0e7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:50.775843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 149/289] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:50.785352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4c3cd-a7c9-4732-9154-13a22fa4d0e7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:50.803462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0419a-39ed-4064-8409-ddecc901961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:50.804140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0419a-39ed-4064-8409-ddecc901961c None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:50.804414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0419a-39ed-4064-8409-ddecc901961c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:50.804685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0419a-39ed-4064-8409-ddecc901961c None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb/users/6ab73aa4f17744f98ef7a5a0aa59e0dc/roles/3d821a5c8fb04a569b693bc2a5feb1da` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:50.807378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0419a-39ed-4064-8409-ddecc901961c None admin] RBAC: Authorizing `identity:create_grant(project_id=3d2568887e324450bce4edcbb25b94bb, user_id=6ab73aa4f17744f98ef7a5a0aa59e0dc, role_id=3d821a5c8fb04a569b693bc2a5feb1da)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:50.808845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0419a-39ed-4064-8409-ddecc901961c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:50.838317 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 141/290] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:18:50 2022] PUT /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb/users/6ab73aa4f17744f98ef7a5a0aa59e0dc/roles/3d821a5c8fb04a569b693bc2a5feb1da => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:18:50.913184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4c3cd-a7c9-4732-9154-13a22fa4d0e7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:50.948418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871c7c2-82d5-4d13-810e-918b08f6d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:50.949012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871c7c2-82d5-4d13-810e-918b08f6d196 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:50.949282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871c7c2-82d5-4d13-810e-918b08f6d196 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:50.949551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871c7c2-82d5-4d13-810e-918b08f6d196 None admin] PATH_INFO: `/v3/users/a9b56277c02f4a43b6ac4cba032de082` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:50.950782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871c7c2-82d5-4d13-810e-918b08f6d196 None admin] RBAC: Authorizing `identity:get_user(user_id=a9b56277c02f4a43b6ac4cba032de082)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:50.952294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871c7c2-82d5-4d13-810e-918b08f6d196 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:50.954317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 150/291] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:50 2022] GET /identity/v3/users/a9b56277c02f4a43b6ac4cba032de082 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:50.960051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0419a-39ed-4064-8409-ddecc901961c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:50.980333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:51.074714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0419a-39ed-4064-8409-ddecc901961c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:51.110815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444c77-26eb-4a75-97ea-15508717e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:51.111476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444c77-26eb-4a75-97ea-15508717e94f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:51.111810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444c77-26eb-4a75-97ea-15508717e94f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:51.112125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444c77-26eb-4a75-97ea-15508717e94f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:51.203048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf444c77-26eb-4a75-97ea-15508717e94f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:51.206427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf444c77-26eb-4a75-97ea-15508717e94f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:51.222004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:51.326035 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 142/292] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:51.332033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871c7c2-82d5-4d13-810e-918b08f6d196 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:51.407142 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:51.475260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871c7c2-82d5-4d13-810e-918b08f6d196 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:51.528061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cb20d-6924-4678-bd26-b42aad0f0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:51.528717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cb20d-6924-4678-bd26-b42aad0f0def None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:51.528997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cb20d-6924-4678-bd26-b42aad0f0def None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:51.529269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cb20d-6924-4678-bd26-b42aad0f0def None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:51.530471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cb20d-6924-4678-bd26-b42aad0f0def None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:51.532018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cb20d-6924-4678-bd26-b42aad0f0def None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:51.534246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 151/293] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:51 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:51.540064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444c77-26eb-4a75-97ea-15508717e94f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:51.678087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444c77-26eb-4a75-97ea-15508717e94f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:51.697252 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:51.723975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10a300-18c8-42e7-9746-1e21b77866fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:51.724586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10a300-18c8-42e7-9746-1e21b77866fe None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:51.724856 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10a300-18c8-42e7-9746-1e21b77866fe None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:51.725121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10a300-18c8-42e7-9746-1e21b77866fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:51.725900 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10a300-18c8-42e7-9746-1e21b77866fe None admin] RBAC: Adding query filter params (role.id=ec48f4c280dd43db99923e3badf5fe36, scope.project.id=3d2568887e324450bce4edcbb25b94bb, user.id=a9b56277c02f4a43b6ac4cba032de082) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:51.726146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10a300-18c8-42e7-9746-1e21b77866fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:51.727606 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10a300-18c8-42e7-9746-1e21b77866fe None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:51.735433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 143/294] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:51 2022] GET /identity/v3/role_assignments?user.id=a9b56277c02f4a43b6ac4cba032de082&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:52.503432 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5181066-316c-4b86-b6e9-dd1eb6067cd3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:52.503982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5181066-316c-4b86-b6e9-dd1eb6067cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:52.504248 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5181066-316c-4b86-b6e9-dd1eb6067cd3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:52.505855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 152/295] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:52.511249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976edb92-fbd1-4e41-9402-dfd3e022fbc3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:52.511725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976edb92-fbd1-4e41-9402-dfd3e022fbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:52.511803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976edb92-fbd1-4e41-9402-dfd3e022fbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:52.529940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-976edb92-fbd1-4e41-9402-dfd3e022fbc3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:52.531132 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-976edb92-fbd1-4e41-9402-dfd3e022fbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:52.534812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c0ba-2970-4034-8a9a-cad2ddb9bc0c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:52.535164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c0ba-2970-4034-8a9a-cad2ddb9bc0c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:52.536195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c0ba-2970-4034-8a9a-cad2ddb9bc0c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:52.536950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 153/296] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:52.541881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb92707-7bcd-49f4-99da-e091f40fe98d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:52.542148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb92707-7bcd-49f4-99da-e091f40fe98d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:52.542418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb92707-7bcd-49f4-99da-e091f40fe98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:52.562542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-acb92707-7bcd-49f4-99da-e091f40fe98d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:52.564915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-acb92707-7bcd-49f4-99da-e091f40fe98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:52.608977 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 144/297] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:52.643784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 154/298] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:52.701519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9eb4-1496-4a10-a838-08871a8d84f8 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:52.701519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9eb4-1496-4a10-a838-08871a8d84f8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:52.701519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9eb4-1496-4a10-a838-08871a8d84f8 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:52.702175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 145/299] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:52.707839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8f485-3ae1-4949-84b2-9f01eefae933 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:52.708211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8f485-3ae1-4949-84b2-9f01eefae933 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:52.708547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8f485-3ae1-4949-84b2-9f01eefae933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:52.727598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e0c8f485-3ae1-4949-84b2-9f01eefae933 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:52.728895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e0c8f485-3ae1-4949-84b2-9f01eefae933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:52.772952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:52.801827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 155/300] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:52.871543 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b9eb4-1496-4a10-a838-08871a8d84f8 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:52.910123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8f485-3ae1-4949-84b2-9f01eefae933 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:52.983278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b9eb4-1496-4a10-a838-08871a8d84f8 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:52.991932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:53.020461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8f485-3ae1-4949-84b2-9f01eefae933 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:53.033612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02f4a9-1ebc-4fca-90f2-8e052efc5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:53.034251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02f4a9-1ebc-4fca-90f2-8e052efc5841 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.034792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02f4a9-1ebc-4fca-90f2-8e052efc5841 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.035061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02f4a9-1ebc-4fca-90f2-8e052efc5841 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.049839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02f4a9-1ebc-4fca-90f2-8e052efc5841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:53.055918 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482298d-66d2-4f39-b274-f360e0538c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ba02f4a9-1ebc-4fca-90f2-8e052efc5841 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:53.056157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:53.057830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:53.059567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:53.060788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482298d-66d2-4f39-b274-f360e0538c42 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.060788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482298d-66d2-4f39-b274-f360e0538c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.060788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482298d-66d2-4f39-b274-f360e0538c42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.067328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 146/301] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:53.067328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02f4a9-1ebc-4fca-90f2-8e052efc5841 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:53.071731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482298d-66d2-4f39-b274-f360e0538c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5482298d-66d2-4f39-b274-f360e0538c42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:53.076749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:53.079130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:53.081113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:53.083009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 156/302] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:53.083601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482298d-66d2-4f39-b274-f360e0538c42 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:53.118189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:53.170062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02f4a9-1ebc-4fca-90f2-8e052efc5841 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:53.189425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482298d-66d2-4f39-b274-f360e0538c42 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:53.204306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f6826-2788-48be-9e37-d586a7d0e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:53.204919 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f6826-2788-48be-9e37-d586a7d0e625 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.205204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f6826-2788-48be-9e37-d586a7d0e625 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.205462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f6826-2788-48be-9e37-d586a7d0e625 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.206129 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f6826-2788-48be-9e37-d586a7d0e625 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:53.206430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f6826-2788-48be-9e37-d586a7d0e625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:53.207844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f6826-2788-48be-9e37-d586a7d0e625 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:53.222472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 147/303] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:53.222472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f6826-2788-48be-9e37-d586a7d0e625 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:53.231681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08c43a-1e72-4ef4-83b4-2c4d399e8691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:53.232317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08c43a-1e72-4ef4-83b4-2c4d399e8691 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.232589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08c43a-1e72-4ef4-83b4-2c4d399e8691 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.232857 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08c43a-1e72-4ef4-83b4-2c4d399e8691 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.233944 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08c43a-1e72-4ef4-83b4-2c4d399e8691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:53.235469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08c43a-1e72-4ef4-83b4-2c4d399e8691 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:53.237033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 157/304] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:53.239465 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08c43a-1e72-4ef4-83b4-2c4d399e8691 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:53.250989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:53.327587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f6826-2788-48be-9e37-d586a7d0e625 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:53.348866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08c43a-1e72-4ef4-83b4-2c4d399e8691 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:53.351136 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:53.364399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073b92-6d02-482f-88a4-54fceebf6924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:53.365211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073b92-6d02-482f-88a4-54fceebf6924 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.365620 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073b92-6d02-482f-88a4-54fceebf6924 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.366126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073b92-6d02-482f-88a4-54fceebf6924 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.367462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073b92-6d02-482f-88a4-54fceebf6924 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:53.367892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073b92-6d02-482f-88a4-54fceebf6924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:53.369396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073b92-6d02-482f-88a4-54fceebf6924 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:53.378353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 148/305] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:53.378940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073b92-6d02-482f-88a4-54fceebf6924 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:53.388787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209445a-88f0-4158-b9ea-67a48f6df838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:53.389430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209445a-88f0-4158-b9ea-67a48f6df838 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.389705 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209445a-88f0-4158-b9ea-67a48f6df838 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.389972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209445a-88f0-4158-b9ea-67a48f6df838 None admin] PATH_INFO: `/v3/users/cbe3efcc570b4dd5a13a5f380b4ada48` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.403480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209445a-88f0-4158-b9ea-67a48f6df838 None admin] RBAC: Authorizing `identity:get_user(user_id=cbe3efcc570b4dd5a13a5f380b4ada48)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:53.404996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209445a-88f0-4158-b9ea-67a48f6df838 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:53.406722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 158/306] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:53 2022] GET /identity/v3/users/cbe3efcc570b4dd5a13a5f380b4ada48 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:53.407512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209445a-88f0-4158-b9ea-67a48f6df838 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:53.479620 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:53.490127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073b92-6d02-482f-88a4-54fceebf6924 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:53.511901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209445a-88f0-4158-b9ea-67a48f6df838 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:53.525260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cac76-fa09-41f8-b3bc-4e19d9597486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:53.526023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cac76-fa09-41f8-b3bc-4e19d9597486 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.526293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cac76-fa09-41f8-b3bc-4e19d9597486 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.526556 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cac76-fa09-41f8-b3bc-4e19d9597486 None admin] PATH_INFO: `/v3/groups` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.527298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cac76-fa09-41f8-b3bc-4e19d9597486 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:53.528751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cac76-fa09-41f8-b3bc-4e19d9597486 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:53.546168 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 149/307] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Oct 6 04:18:53 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:53.547065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6d05-91e9-41b8-bd1b-148c1bd7df9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:53.547891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6d05-91e9-41b8-bd1b-148c1bd7df9f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.548269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6d05-91e9-41b8-bd1b-148c1bd7df9f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.548911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6d05-91e9-41b8-bd1b-148c1bd7df9f None admin] PATH_INFO: `/v3/users/768a4d7e4b0a4686bab4c462a886b231` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.550220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6d05-91e9-41b8-bd1b-148c1bd7df9f None admin] RBAC: Authorizing `identity:get_user(user_id=768a4d7e4b0a4686bab4c462a886b231)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:53.551871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6d05-91e9-41b8-bd1b-148c1bd7df9f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:53.553780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 159/308] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:53 2022] GET /identity/v3/users/768a4d7e4b0a4686bab4c462a886b231 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:53.554953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cac76-fa09-41f8-b3bc-4e19d9597486 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:53.567642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6d05-91e9-41b8-bd1b-148c1bd7df9f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:53.603552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:53.700823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6d05-91e9-41b8-bd1b-148c1bd7df9f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:53.711388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cac76-fa09-41f8-b3bc-4e19d9597486 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:53.747641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af866be7-5d37-4094-9f09-d4abf580d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:53.748317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af866be7-5d37-4094-9f09-d4abf580d046 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.748667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af866be7-5d37-4094-9f09-d4abf580d046 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.749003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af866be7-5d37-4094-9f09-d4abf580d046 None admin] PATH_INFO: `/v3/system/users/768a4d7e4b0a4686bab4c462a886b231/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.750530 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af866be7-5d37-4094-9f09-d4abf580d046 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=768a4d7e4b0a4686bab4c462a886b231, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:53.751953 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af866be7-5d37-4094-9f09-d4abf580d046 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:53.752073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1aa9a-aa07-452e-891f-723519601a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:53.752674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1aa9a-aa07-452e-891f-723519601a61 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.752945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1aa9a-aa07-452e-891f-723519601a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.753206 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1aa9a-aa07-452e-891f-723519601a61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.754735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1aa9a-aa07-452e-891f-723519601a61 None admin] RBAC: Adding query filter params (role.id=3d821a5c8fb04a569b693bc2a5feb1da, user.id=cbe3efcc570b4dd5a13a5f380b4ada48, scope.system=all) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:53.755045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1aa9a-aa07-452e-891f-723519601a61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:53.756565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1aa9a-aa07-452e-891f-723519601a61 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:53.762329 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 150/309] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Oct 6 04:18:53 2022] GET /identity/v3/role_assignments?user.id=cbe3efcc570b4dd5a13a5f380b4ada48&scope.system=all&role.id=3d821a5c8fb04a569b693bc2a5feb1da => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:53.762863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 160/310] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Oct 6 04:18:53 2022] PUT /identity/v3/system/users/768a4d7e4b0a4686bab4c462a886b231/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:18:53.764589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b1fab-131c-459b-aefb-65a2c6ef64bc None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.765011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b1fab-131c-459b-aefb-65a2c6ef64bc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.765419 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b1fab-131c-459b-aefb-65a2c6ef64bc None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.767098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 151/311] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:53.773219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13091b-3475-452a-b303-fe0c9f3b3de4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:53.773488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13091b-3475-452a-b303-fe0c9f3b3de4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:53.773768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13091b-3475-452a-b303-fe0c9f3b3de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:53.797028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2e13091b-3475-452a-b303-fe0c9f3b3de4 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:53.798434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2e13091b-3475-452a-b303-fe0c9f3b3de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:53.890189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 161/312] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:54.159168 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b1fab-131c-459b-aefb-65a2c6ef64bc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:54.175552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:54.267778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b1fab-131c-459b-aefb-65a2c6ef64bc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:54.302353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac29f-e8b9-4a65-940d-c7a042d918c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:54.302988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac29f-e8b9-4a65-940d-c7a042d918c3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:54.303263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac29f-e8b9-4a65-940d-c7a042d918c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:54.303563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac29f-e8b9-4a65-940d-c7a042d918c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:54.322589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ac29f-e8b9-4a65-940d-c7a042d918c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-370ac29f-e8b9-4a65-940d-c7a042d918c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:54.327573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:54.328521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:54.329323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 152/313] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:54.335015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13091b-3475-452a-b303-fe0c9f3b3de4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:54.361158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:54.437254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13091b-3475-452a-b303-fe0c9f3b3de4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:54.477458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a0daf-8790-4182-97b9-844991533845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:54.478081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a0daf-8790-4182-97b9-844991533845 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:54.478355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a0daf-8790-4182-97b9-844991533845 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:54.478664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a0daf-8790-4182-97b9-844991533845 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:54.479379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a0daf-8790-4182-97b9-844991533845 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:54.479684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a0daf-8790-4182-97b9-844991533845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:54.481063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a0daf-8790-4182-97b9-844991533845 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:54.489687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 162/314] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:54.495891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac29f-e8b9-4a65-940d-c7a042d918c3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:54.575011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:54.605871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac29f-e8b9-4a65-940d-c7a042d918c3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:54.640155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b08749-e18a-4690-bb33-e058d7e37e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:54.640788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b08749-e18a-4690-bb33-e058d7e37e49 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:54.641112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b08749-e18a-4690-bb33-e058d7e37e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:54.641378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b08749-e18a-4690-bb33-e058d7e37e49 None admin] PATH_INFO: `/v3/users/6ab73aa4f17744f98ef7a5a0aa59e0dc` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:54.642578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b08749-e18a-4690-bb33-e058d7e37e49 None admin] RBAC: Authorizing `identity:get_user(user_id=6ab73aa4f17744f98ef7a5a0aa59e0dc)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:54.644077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b08749-e18a-4690-bb33-e058d7e37e49 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:54.645972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 153/315] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:54 2022] GET /identity/v3/users/6ab73aa4f17744f98ef7a5a0aa59e0dc => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:54.652422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a0daf-8790-4182-97b9-844991533845 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:54.744338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:54.759135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a0daf-8790-4182-97b9-844991533845 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:54.791859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012df618-20bf-467d-bda6-7bc916f94c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:54.792475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012df618-20bf-467d-bda6-7bc916f94c3c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:54.792751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012df618-20bf-467d-bda6-7bc916f94c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:54.793024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012df618-20bf-467d-bda6-7bc916f94c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:54.859011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012df618-20bf-467d-bda6-7bc916f94c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:54.860632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012df618-20bf-467d-bda6-7bc916f94c3c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:54.944448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:54.960428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 163/316] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:18:54.966093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b08749-e18a-4690-bb33-e058d7e37e49 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:55.069138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b08749-e18a-4690-bb33-e058d7e37e49 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:55.106727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452337c8-a847-4dac-82b7-5641d5bdce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:55.107386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452337c8-a847-4dac-82b7-5641d5bdce1e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:55.107662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452337c8-a847-4dac-82b7-5641d5bdce1e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:55.107931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452337c8-a847-4dac-82b7-5641d5bdce1e None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:55.109033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452337c8-a847-4dac-82b7-5641d5bdce1e None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:55.110533 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452337c8-a847-4dac-82b7-5641d5bdce1e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:55.112561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 154/317] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:18:54 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:55.118723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012df618-20bf-467d-bda6-7bc916f94c3c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:55.217842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012df618-20bf-467d-bda6-7bc916f94c3c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:55.252173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3880d-5e72-46a9-9bd9-5b21146c2ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:55.253066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3880d-5e72-46a9-9bd9-5b21146c2ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:55.253534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3880d-5e72-46a9-9bd9-5b21146c2ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:55.254017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3880d-5e72-46a9-9bd9-5b21146c2ad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:55.254936 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3880d-5e72-46a9-9bd9-5b21146c2ad4 None admin] RBAC: Adding query filter params (role.id=3d821a5c8fb04a569b693bc2a5feb1da, scope.project.id=3d2568887e324450bce4edcbb25b94bb, user.id=6ab73aa4f17744f98ef7a5a0aa59e0dc) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:55.255459 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3880d-5e72-46a9-9bd9-5b21146c2ad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:55.257108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3880d-5e72-46a9-9bd9-5b21146c2ad4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:55.263456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 164/318] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:18:55 2022] GET /identity/v3/role_assignments?user.id=6ab73aa4f17744f98ef7a5a0aa59e0dc&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=3d821a5c8fb04a569b693bc2a5feb1da => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:55.891338 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93812325-a80e-42dd-bb2e-941f2fe473e0 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:55.891948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93812325-a80e-42dd-bb2e-941f2fe473e0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:55.891948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93812325-a80e-42dd-bb2e-941f2fe473e0 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:55.893294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 155/319] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:55.899819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c6a93-8535-46dd-89aa-ad88aa82a30b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:55.900329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c6a93-8535-46dd-89aa-ad88aa82a30b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:55.900329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c6a93-8535-46dd-89aa-ad88aa82a30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:55.920486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3f9c6a93-8535-46dd-89aa-ad88aa82a30b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:55.921700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3f9c6a93-8535-46dd-89aa-ad88aa82a30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:55.972343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:55.984447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2ad51-820c-40c8-9135-9f3953412a22 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:55.985134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2ad51-820c-40c8-9135-9f3953412a22 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:55.985421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2ad51-820c-40c8-9135-9f3953412a22 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:55.987153 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 156/320] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:55.994014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48a06-6f8a-474c-bfcc-5e74ec8796be None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:55.994566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48a06-6f8a-474c-bfcc-5e74ec8796be None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:55.994904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48a06-6f8a-474c-bfcc-5e74ec8796be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:55.996629 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 165/321] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:56.011059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d154da-d3e8-4bd2-abec-fe17661d5053 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:56.011403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d154da-d3e8-4bd2-abec-fe17661d5053 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:56.011594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d154da-d3e8-4bd2-abec-fe17661d5053 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:56.013127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 166/322] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:56.013748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1ee48a06-6f8a-474c-bfcc-5e74ec8796be None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:56.014932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1ee48a06-6f8a-474c-bfcc-5e74ec8796be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:56.017830 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c379f-4535-45e7-b0e4-d4f7287464d9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:56.018073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:56.018173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c379f-4535-45e7-b0e4-d4f7287464d9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:56.018358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c379f-4535-45e7-b0e4-d4f7287464d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:56.036033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b36c379f-4535-45e7-b0e4-d4f7287464d9 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:56.037201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b36c379f-4535-45e7-b0e4-d4f7287464d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:56.086122 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 157/323] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:18:56.104862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 167/324] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:56.263261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee48a06-6f8a-474c-bfcc-5e74ec8796be None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:56.349766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c379f-4535-45e7-b0e4-d4f7287464d9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:56.372510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee48a06-6f8a-474c-bfcc-5e74ec8796be None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:56.405220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2388a-f7b2-4bc0-939f-59d1df898d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:56.405855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2388a-f7b2-4bc0-939f-59d1df898d3d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:56.406131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2388a-f7b2-4bc0-939f-59d1df898d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:56.406402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2388a-f7b2-4bc0-939f-59d1df898d3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:56.407580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2388a-f7b2-4bc0-939f-59d1df898d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:56.409031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2388a-f7b2-4bc0-939f-59d1df898d3d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:56.410603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 158/325] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:18:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:56.411480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2388a-f7b2-4bc0-939f-59d1df898d3d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:56.423292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:56.448204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c379f-4535-45e7-b0e4-d4f7287464d9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:56.458904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:56.482640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbffaf-4654-474c-89b5-8e499caad771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:56.483282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbffaf-4654-474c-89b5-8e499caad771 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:56.483581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbffaf-4654-474c-89b5-8e499caad771 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:56.483852 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbffaf-4654-474c-89b5-8e499caad771 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:56.496878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbffaf-4654-474c-89b5-8e499caad771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-11bbffaf-4654-474c-89b5-8e499caad771 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:56.501752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:56.503086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 168/326] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:18:56.504133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbffaf-4654-474c-89b5-8e499caad771 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:56.515730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2388a-f7b2-4bc0-939f-59d1df898d3d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:56.556187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e36c7-6ac9-4223-b30a-77af0bcafe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:56.556817 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e36c7-6ac9-4223-b30a-77af0bcafe1e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:56.557096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e36c7-6ac9-4223-b30a-77af0bcafe1e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:56.557360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e36c7-6ac9-4223-b30a-77af0bcafe1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:56.567342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e36c7-6ac9-4223-b30a-77af0bcafe1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-803e36c7-6ac9-4223-b30a-77af0bcafe1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:18:56.572609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:18:56.573496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 159/327] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:18:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:18:56.575997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e36c7-6ac9-4223-b30a-77af0bcafe1e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:56.603907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbffaf-4654-474c-89b5-8e499caad771 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:56.637896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2c6de-e5e0-48df-9053-cf4335c4a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:56.638505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2c6de-e5e0-48df-9053-cf4335c4a53f None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:56.638804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2c6de-e5e0-48df-9053-cf4335c4a53f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:56.639073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2c6de-e5e0-48df-9053-cf4335c4a53f None admin] PATH_INFO: `/v3/groups` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:56.639730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2c6de-e5e0-48df-9053-cf4335c4a53f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:56.641222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2c6de-e5e0-48df-9053-cf4335c4a53f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:56.641706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:56.656426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 169/328] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Oct 6 04:18:56 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:18:56.657518 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2c6de-e5e0-48df-9053-cf4335c4a53f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:56.676509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e36c7-6ac9-4223-b30a-77af0bcafe1e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:56.700454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:56.715023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab68c-c4d4-46ec-b2aa-bf9243786b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:56.715654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab68c-c4d4-46ec-b2aa-bf9243786b3e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:56.715919 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab68c-c4d4-46ec-b2aa-bf9243786b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:56.716179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab68c-c4d4-46ec-b2aa-bf9243786b3e None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:56.716912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ab68c-c4d4-46ec-b2aa-bf9243786b3e None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:56.717342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ab68c-c4d4-46ec-b2aa-bf9243786b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:56.718816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ab68c-c4d4-46ec-b2aa-bf9243786b3e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:56.728785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 160/329] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:56.734741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab68c-c4d4-46ec-b2aa-bf9243786b3e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:56.784705 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2c6de-e5e0-48df-9053-cf4335c4a53f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:56.822121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad23775-3dc4-4359-8697-1c2c013f9fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:56.822752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23775-3dc4-4359-8697-1c2c013f9fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:56.823027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23775-3dc4-4359-8697-1c2c013f9fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:56.823294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23775-3dc4-4359-8697-1c2c013f9fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:56.823999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad23775-3dc4-4359-8697-1c2c013f9fc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:56.824304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad23775-3dc4-4359-8697-1c2c013f9fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:56.825711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad23775-3dc4-4359-8697-1c2c013f9fc6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:56.837877 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 170/330] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:18:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:56.843652 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad23775-3dc4-4359-8697-1c2c013f9fc6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:56.854108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab68c-c4d4-46ec-b2aa-bf9243786b3e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:56.885524 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:56.892759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e08057-7bf7-4068-9fce-7b1cf4b9ad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:56.894335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08057-7bf7-4068-9fce-7b1cf4b9ad13 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:56.894335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08057-7bf7-4068-9fce-7b1cf4b9ad13 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:56.894335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08057-7bf7-4068-9fce-7b1cf4b9ad13 None admin] PATH_INFO: `/v3/users/768a4d7e4b0a4686bab4c462a886b231` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:56.895482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e08057-7bf7-4068-9fce-7b1cf4b9ad13 None admin] RBAC: Authorizing `identity:get_user(user_id=768a4d7e4b0a4686bab4c462a886b231)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:56.896944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e08057-7bf7-4068-9fce-7b1cf4b9ad13 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:56.898541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 161/331] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:56 2022] GET /identity/v3/users/768a4d7e4b0a4686bab4c462a886b231 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:56.906876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e08057-7bf7-4068-9fce-7b1cf4b9ad13 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:56.952784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:56.967466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad23775-3dc4-4359-8697-1c2c013f9fc6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:57.011446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a25f-e091-43ea-821a-a0917f231f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:57.012085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a25f-e091-43ea-821a-a0917f231f53 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:57.012355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a25f-e091-43ea-821a-a0917f231f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:57.012619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a25f-e091-43ea-821a-a0917f231f53 None admin] PATH_INFO: `/v3/users/cbe3efcc570b4dd5a13a5f380b4ada48` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:57.014557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92a25f-e091-43ea-821a-a0917f231f53 None admin] RBAC: Authorizing `identity:get_user(user_id=cbe3efcc570b4dd5a13a5f380b4ada48)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:57.016190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92a25f-e091-43ea-821a-a0917f231f53 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:57.023257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 171/332] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:18:56 2022] GET /identity/v3/users/cbe3efcc570b4dd5a13a5f380b4ada48 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:18:57.024668 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a25f-e091-43ea-821a-a0917f231f53 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:18:57.029169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e08057-7bf7-4068-9fce-7b1cf4b9ad13 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:57.072443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa73e-a63f-4133-b209-ef3864d93700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:57.073352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa73e-a63f-4133-b209-ef3864d93700 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:57.074515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa73e-a63f-4133-b209-ef3864d93700 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:57.074798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa73e-a63f-4133-b209-ef3864d93700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:57.075582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fa73e-a63f-4133-b209-ef3864d93700 None admin] RBAC: Adding query filter params (role.id=ec48f4c280dd43db99923e3badf5fe36, user.id=768a4d7e4b0a4686bab4c462a886b231, scope.system=all) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:18:57.075892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fa73e-a63f-4133-b209-ef3864d93700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:57.077345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fa73e-a63f-4133-b209-ef3864d93700 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:57.097654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 162/333] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Oct 6 04:18:56 2022] GET /identity/v3/role_assignments?user.id=768a4d7e4b0a4686bab4c462a886b231&scope.system=all&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:18:57.154420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a25f-e091-43ea-821a-a0917f231f53 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:18:57.196558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06077ab-9050-4db6-b1f0-2e688970579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:18:57.197241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06077ab-9050-4db6-b1f0-2e688970579e None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:57.197516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06077ab-9050-4db6-b1f0-2e688970579e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:57.197788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06077ab-9050-4db6-b1f0-2e688970579e None admin] PATH_INFO: `/v3/system/users/cbe3efcc570b4dd5a13a5f380b4ada48/roles/3d821a5c8fb04a569b693bc2a5feb1da` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:57.201805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06077ab-9050-4db6-b1f0-2e688970579e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cbe3efcc570b4dd5a13a5f380b4ada48, role_id=3d821a5c8fb04a569b693bc2a5feb1da)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:18:57.203013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06077ab-9050-4db6-b1f0-2e688970579e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:18:57.222021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 172/334] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Oct 6 04:18:57 2022] PUT /identity/v3/system/users/cbe3efcc570b4dd5a13a5f380b4ada48/roles/3d821a5c8fb04a569b693bc2a5feb1da => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:18:59.487107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6f1a-c4a7-4c94-82ac-723417cd47dc None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:59.487704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6f1a-c4a7-4c94-82ac-723417cd47dc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:59.487704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6f1a-c4a7-4c94-82ac-723417cd47dc None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:59.489309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 163/335] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:59.495355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba89df-19a2-4062-a40f-854bc6845d1e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:59.495766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba89df-19a2-4062-a40f-854bc6845d1e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:59.495933 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba89df-19a2-4062-a40f-854bc6845d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:59.532348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3aba89df-19a2-4062-a40f-854bc6845d1e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:59.533567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3aba89df-19a2-4062-a40f-854bc6845d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:59.554678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:59.588901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda543d-e42a-41b8-95ea-5677cb3feced None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:59.589070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda543d-e42a-41b8-95ea-5677cb3feced None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:59.589338 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda543d-e42a-41b8-95ea-5677cb3feced None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:59.590913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 164/336] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:59.600389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e85169-7ccd-4607-84b5-6b93a9b7e4ee None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:59.600685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e85169-7ccd-4607-84b5-6b93a9b7e4ee None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:59.600930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e85169-7ccd-4607-84b5-6b93a9b7e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:59.623719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b4e85169-7ccd-4607-84b5-6b93a9b7e4ee None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:59.625437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b4e85169-7ccd-4607-84b5-6b93a9b7e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:59.628875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 173/337] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:59.703098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:18:59.726234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 165/338] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:18:59.870381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a47cb-2ba5-4e65-ac98-10775c618c83 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:59.870570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a47cb-2ba5-4e65-ac98-10775c618c83 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:59.870836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a47cb-2ba5-4e65-ac98-10775c618c83 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:59.872248 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 174/339] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:18:59.877933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9211d0-5f41-4f61-80d4-f89caf69dac2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:59.878209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9211d0-5f41-4f61-80d4-f89caf69dac2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:59.878477 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9211d0-5f41-4f61-80d4-f89caf69dac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:59.899616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ae9211d0-5f41-4f61-80d4-f89caf69dac2 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:18:59.900792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ae9211d0-5f41-4f61-80d4-f89caf69dac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:18:59.959924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b6bfd-1e15-4a19-84b0-0d0669dbc557 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:59.960274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b6bfd-1e15-4a19-84b0-0d0669dbc557 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:59.960470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b6bfd-1e15-4a19-84b0-0d0669dbc557 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:59.962102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 175/340] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:18:59.967298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508e3e-f776-4c65-8868-91f5e743e3a1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:18:59.967614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508e3e-f776-4c65-8868-91f5e743e3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:18:59.967897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508e3e-f776-4c65-8868-91f5e743e3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:18:59.986969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 166/341] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:00.008374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-db508e3e-f776-4c65-8868-91f5e743e3a1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:00.009582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-db508e3e-f776-4c65-8868-91f5e743e3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:00.024354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9211d0-5f41-4f61-80d4-f89caf69dac2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:00.128336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 176/342] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:19:00.178958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9211d0-5f41-4f61-80d4-f89caf69dac2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:00.200301 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:00.222384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a800455-7db4-4ad4-ba0b-1eae86a861e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:00.223041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a800455-7db4-4ad4-ba0b-1eae86a861e3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:00.223331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a800455-7db4-4ad4-ba0b-1eae86a861e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:00.223612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a800455-7db4-4ad4-ba0b-1eae86a861e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:00.230235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db508e3e-f776-4c65-8868-91f5e743e3a1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:00.234684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a800455-7db4-4ad4-ba0b-1eae86a861e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-8a800455-7db4-4ad4-ba0b-1eae86a861e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:00.240425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:00.241678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:00.242478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 167/343] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:19:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:00.249304 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a800455-7db4-4ad4-ba0b-1eae86a861e3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:00.351241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:00.370082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db508e3e-f776-4c65-8868-91f5e743e3a1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:00.393015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a800455-7db4-4ad4-ba0b-1eae86a861e3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:00.408861 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc97a3f-4e0a-4635-a69e-3be7fc0bd381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:00.409806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc97a3f-4e0a-4635-a69e-3be7fc0bd381 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:00.410250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc97a3f-4e0a-4635-a69e-3be7fc0bd381 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:00.410709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc97a3f-4e0a-4635-a69e-3be7fc0bd381 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:00.422201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc97a3f-4e0a-4635-a69e-3be7fc0bd381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-dcc97a3f-4e0a-4635-a69e-3be7fc0bd381 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:00.427755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:00.428666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:00.432131 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 177/344] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:00.439708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc97a3f-4e0a-4635-a69e-3be7fc0bd381 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:00.448923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce90c4-8465-4299-86c8-6df236af3da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:00.449621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce90c4-8465-4299-86c8-6df236af3da3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:00.449960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce90c4-8465-4299-86c8-6df236af3da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:00.450292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce90c4-8465-4299-86c8-6df236af3da3 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:00.451035 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce90c4-8465-4299-86c8-6df236af3da3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:00.451470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce90c4-8465-4299-86c8-6df236af3da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:00.452946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce90c4-8465-4299-86c8-6df236af3da3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:00.468178 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 168/345] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:00.474049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce90c4-8465-4299-86c8-6df236af3da3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:00.537731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:00.563896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc97a3f-4e0a-4635-a69e-3be7fc0bd381 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:00.635881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055b836-2d03-4277-aaad-f41c554284fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:00.636496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055b836-2d03-4277-aaad-f41c554284fc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:00.636771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055b836-2d03-4277-aaad-f41c554284fc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:00.637037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055b836-2d03-4277-aaad-f41c554284fc None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:00.637710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055b836-2d03-4277-aaad-f41c554284fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:00.638011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055b836-2d03-4277-aaad-f41c554284fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:00.639415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055b836-2d03-4277-aaad-f41c554284fc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:00.645595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce90c4-8465-4299-86c8-6df236af3da3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:00.652183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 178/346] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:19:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:00.653098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055b836-2d03-4277-aaad-f41c554284fc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:00.669593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:00.697367 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bd2a2-87f0-4f95-b146-83c89e444a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:00.698923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bd2a2-87f0-4f95-b146-83c89e444a12 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:00.699434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bd2a2-87f0-4f95-b146-83c89e444a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:00.700066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bd2a2-87f0-4f95-b146-83c89e444a12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:00.787048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055b836-2d03-4277-aaad-f41c554284fc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:00.795243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bd2a2-87f0-4f95-b146-83c89e444a12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:00.797095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bd2a2-87f0-4f95-b146-83c89e444a12 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:00.827618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f497b-3ee0-4bc0-b39c-2d9fae89b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:00.828297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f497b-3ee0-4bc0-b39c-2d9fae89b940 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:00.828600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f497b-3ee0-4bc0-b39c-2d9fae89b940 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:00.828921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f497b-3ee0-4bc0-b39c-2d9fae89b940 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:00.841594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f497b-3ee0-4bc0-b39c-2d9fae89b940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-389f497b-3ee0-4bc0-b39c-2d9fae89b940 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:00.848339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:00.849365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:00.850198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 179/347] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:00.850880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f497b-3ee0-4bc0-b39c-2d9fae89b940 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:00.852791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:00.921867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 169/348] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:00.922747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bd2a2-87f0-4f95-b146-83c89e444a12 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:00.930942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:00.974603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f497b-3ee0-4bc0-b39c-2d9fae89b940 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:01.015985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7275020-cb60-4f69-a218-24104f38223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:01.017108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7275020-cb60-4f69-a218-24104f38223a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:01.017632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7275020-cb60-4f69-a218-24104f38223a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:01.018124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7275020-cb60-4f69-a218-24104f38223a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:01.031086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7275020-cb60-4f69-a218-24104f38223a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e7275020-cb60-4f69-a218-24104f38223a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:01.038001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:01.038913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 04:19:01.039738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:01.040356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bd2a2-87f0-4f95-b146-83c89e444a12 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:01.046794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 180/349] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:01.048734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7275020-cb60-4f69-a218-24104f38223a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:01.079813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6091d8-237b-4c16-b1f1-0c844ba77d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:01.080434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6091d8-237b-4c16-b1f1-0c844ba77d44 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:01.080708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6091d8-237b-4c16-b1f1-0c844ba77d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:01.080975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6091d8-237b-4c16-b1f1-0c844ba77d44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:01.092167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:01.161262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6091d8-237b-4c16-b1f1-0c844ba77d44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:01.162750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6091d8-237b-4c16-b1f1-0c844ba77d44 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:01.181531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7275020-cb60-4f69-a218-24104f38223a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:01.212340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:01.222127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a7fcb-21f9-4dab-83bb-e629ca620393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:01.223526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a7fcb-21f9-4dab-83bb-e629ca620393 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:01.224289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a7fcb-21f9-4dab-83bb-e629ca620393 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:01.224909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a7fcb-21f9-4dab-83bb-e629ca620393 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:01.225906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a7fcb-21f9-4dab-83bb-e629ca620393 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:01.226479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a7fcb-21f9-4dab-83bb-e629ca620393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:01.228406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a7fcb-21f9-4dab-83bb-e629ca620393 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:01.239912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 181/350] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:19:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:01.241068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a7fcb-21f9-4dab-83bb-e629ca620393 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:01.276153 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 170/351] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:01.276878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6091d8-237b-4c16-b1f1-0c844ba77d44 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:01.348168 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:01.388070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a7fcb-21f9-4dab-83bb-e629ca620393 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:01.433441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6b8fe-b877-4c78-acf1-95f6873ea18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:01.434011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6b8fe-b877-4c78-acf1-95f6873ea18f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:01.434290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6b8fe-b877-4c78-acf1-95f6873ea18f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:01.435506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6b8fe-b877-4c78-acf1-95f6873ea18f None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:01.436702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6b8fe-b877-4c78-acf1-95f6873ea18f None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:01.437572 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6b8fe-b877-4c78-acf1-95f6873ea18f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:01.441440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 182/352] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:01 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:01.441581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6091d8-237b-4c16-b1f1-0c844ba77d44 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:01.441670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6b8fe-b877-4c78-acf1-95f6873ea18f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:01.497015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576211a9-2677-43fd-b872-a63296e58f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:01.497015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576211a9-2677-43fd-b872-a63296e58f2f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:01.497338 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576211a9-2677-43fd-b872-a63296e58f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:01.497573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576211a9-2677-43fd-b872-a63296e58f2f None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:01.498518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576211a9-2677-43fd-b872-a63296e58f2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:01.498518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576211a9-2677-43fd-b872-a63296e58f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:01.500005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576211a9-2677-43fd-b872-a63296e58f2f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:01.509504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 171/353] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:19:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:01.510381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576211a9-2677-43fd-b872-a63296e58f2f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:01.526706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:01.580355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6b8fe-b877-4c78-acf1-95f6873ea18f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:01.628326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5242e8-d17d-4a81-a7a4-7087323dd5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:01.628955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5242e8-d17d-4a81-a7a4-7087323dd5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:01.629233 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5242e8-d17d-4a81-a7a4-7087323dd5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:01.629498 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5242e8-d17d-4a81-a7a4-7087323dd5d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:01.636454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:01.639536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576211a9-2677-43fd-b872-a63296e58f2f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:01.677379 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fca74-c182-4466-9642-d2de3b8f3835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:01.677379 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fca74-c182-4466-9642-d2de3b8f3835 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:01.677379 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fca74-c182-4466-9642-d2de3b8f3835 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:01.677748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fca74-c182-4466-9642-d2de3b8f3835 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:01.678849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fca74-c182-4466-9642-d2de3b8f3835 None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:01.680359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fca74-c182-4466-9642-d2de3b8f3835 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:01.681982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 172/354] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:01 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:01.683096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e50bfa-421b-4619-abbc-d14ecfbaffae None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:01.683545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e50bfa-421b-4619-abbc-d14ecfbaffae None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:01.683762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e50bfa-421b-4619-abbc-d14ecfbaffae None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:01.689084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 173/355] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:01.689084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e50bfa-421b-4619-abbc-d14ecfbaffae None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:01.717774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5242e8-d17d-4a81-a7a4-7087323dd5d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:01.719643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5242e8-d17d-4a81-a7a4-7087323dd5d9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:01.785642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:01.811607 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e50bfa-421b-4619-abbc-d14ecfbaffae None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:01.844297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 183/356] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:01.845266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5242e8-d17d-4a81-a7a4-7087323dd5d9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:01.855297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00c4e0-c00a-4d17-bbcc-b6f6bff621f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:01.855297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c4e0-c00a-4d17-bbcc-b6f6bff621f0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:01.855297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c4e0-c00a-4d17-bbcc-b6f6bff621f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:01.855297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c4e0-c00a-4d17-bbcc-b6f6bff621f0 None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:01.863359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c4e0-c00a-4d17-bbcc-b6f6bff621f0 None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:01.865300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c4e0-c00a-4d17-bbcc-b6f6bff621f0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:01.867507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 174/357] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:01 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:01.868978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543da7d5-0fe8-4f98-be54-dd264ef11498 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:01.869405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543da7d5-0fe8-4f98-be54-dd264ef11498 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:01.869796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543da7d5-0fe8-4f98-be54-dd264ef11498 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:01.871290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 175/358] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:01.872553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543da7d5-0fe8-4f98-be54-dd264ef11498 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:01.907644 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:01.957348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5242e8-d17d-4a81-a7a4-7087323dd5d9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:01.984937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543da7d5-0fe8-4f98-be54-dd264ef11498 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:02.000118 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252225d8-357a-4df8-8c3b-46185eab4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:02.000916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252225d8-357a-4df8-8c3b-46185eab4adf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.001273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252225d8-357a-4df8-8c3b-46185eab4adf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.001613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252225d8-357a-4df8-8c3b-46185eab4adf None admin] PATH_INFO: `/v3/users/cbe3efcc570b4dd5a13a5f380b4ada48` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.003731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252225d8-357a-4df8-8c3b-46185eab4adf None admin] RBAC: Authorizing `identity:get_user(user_id=cbe3efcc570b4dd5a13a5f380b4ada48)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:02.004636 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252225d8-357a-4df8-8c3b-46185eab4adf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:02.006037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 184/359] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:19:01 2022] GET /identity/v3/users/cbe3efcc570b4dd5a13a5f380b4ada48 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:02.006977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca1ebd-0fb9-4475-b995-70c280ec9dee None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.007256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca1ebd-0fb9-4475-b995-70c280ec9dee None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.008528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca1ebd-0fb9-4475-b995-70c280ec9dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.029660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-98ca1ebd-0fb9-4475-b995-70c280ec9dee None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:02.030859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-98ca1ebd-0fb9-4475-b995-70c280ec9dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:02.035121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41f1e5-7687-41ea-80c1-1f7a1344d830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:02.035793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41f1e5-7687-41ea-80c1-1f7a1344d830 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.036062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41f1e5-7687-41ea-80c1-1f7a1344d830 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.036325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41f1e5-7687-41ea-80c1-1f7a1344d830 None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.037416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41f1e5-7687-41ea-80c1-1f7a1344d830 None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:02.038853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41f1e5-7687-41ea-80c1-1f7a1344d830 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:02.040479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 176/360] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:01 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:02.041312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41f1e5-7687-41ea-80c1-1f7a1344d830 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:02.051719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:02.107706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 185/361] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:02.111345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca1ebd-0fb9-4475-b995-70c280ec9dee None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:02.163172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:02.166896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41f1e5-7687-41ea-80c1-1f7a1344d830 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:02.208525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed71d27-8e6c-4214-901c-259b3a2dfe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:02.209094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed71d27-8e6c-4214-901c-259b3a2dfe95 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.209369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed71d27-8e6c-4214-901c-259b3a2dfe95 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.209638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed71d27-8e6c-4214-901c-259b3a2dfe95 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.211106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed71d27-8e6c-4214-901c-259b3a2dfe95 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:02.213156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed71d27-8e6c-4214-901c-259b3a2dfe95 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:02.215862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 177/362] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:02 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:02.217198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07ab2a-52ef-4402-ab11-b14708b9b7d3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.217480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07ab2a-52ef-4402-ab11-b14708b9b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.218028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07ab2a-52ef-4402-ab11-b14708b9b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.235774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca1ebd-0fb9-4475-b995-70c280ec9dee None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:02.240921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7b07ab2a-52ef-4402-ab11-b14708b9b7d3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:02.242471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7b07ab2a-52ef-4402-ab11-b14708b9b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:02.278640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbbf9e-fcb8-4eb7-9790-88e7fc2f7fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:02.280275 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbbf9e-fcb8-4eb7-9790-88e7fc2f7fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.280748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbbf9e-fcb8-4eb7-9790-88e7fc2f7fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.281021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbbf9e-fcb8-4eb7-9790-88e7fc2f7fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.283182 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbbf9e-fcb8-4eb7-9790-88e7fc2f7fc7 None admin] RBAC: Adding query filter params (group.id=6533b0246a974234a759221886ea231d, role.id=35a096ec554741cb99e599760e23fe4d, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:02.283182 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbbf9e-fcb8-4eb7-9790-88e7fc2f7fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:02.283540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbbf9e-fcb8-4eb7-9790-88e7fc2f7fc7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:02.293211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 186/363] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 6 04:19:02 2022] GET /identity/v3/role_assignments?group.id=6533b0246a974234a759221886ea231d&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=35a096ec554741cb99e599760e23fe4d => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:02.295803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbbf9e-fcb8-4eb7-9790-88e7fc2f7fc7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:02.324083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:02.340224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 178/364] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:02.341176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07ab2a-52ef-4402-ab11-b14708b9b7d3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:02.425468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbbf9e-fcb8-4eb7-9790-88e7fc2f7fc7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:02.448620 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:02.452795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07ab2a-52ef-4402-ab11-b14708b9b7d3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:02.464741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db42cb-4218-43bc-9c64-ce30391d14ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:02.465702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db42cb-4218-43bc-9c64-ce30391d14ba None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.466197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db42cb-4218-43bc-9c64-ce30391d14ba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.466761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db42cb-4218-43bc-9c64-ce30391d14ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.467836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db42cb-4218-43bc-9c64-ce30391d14ba None admin] RBAC: Adding query filter params (role.id=3d821a5c8fb04a569b693bc2a5feb1da, user.id=cbe3efcc570b4dd5a13a5f380b4ada48, scope.system=all) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:02.468417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db42cb-4218-43bc-9c64-ce30391d14ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:02.470593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db42cb-4218-43bc-9c64-ce30391d14ba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:02.484347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 187/365] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Oct 6 04:19:02 2022] GET /identity/v3/role_assignments?user.id=cbe3efcc570b4dd5a13a5f380b4ada48&scope.system=all&role.id=3d821a5c8fb04a569b693bc2a5feb1da => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:02.485882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db42cb-4218-43bc-9c64-ce30391d14ba None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:02.494819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa142274-3f6d-4c2c-ad9a-5f522211c0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:02.495481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa142274-3f6d-4c2c-ad9a-5f522211c0cd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.495754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa142274-3f6d-4c2c-ad9a-5f522211c0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.496023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa142274-3f6d-4c2c-ad9a-5f522211c0cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.496760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa142274-3f6d-4c2c-ad9a-5f522211c0cd None admin] RBAC: Adding query filter params (group.id=6533b0246a974234a759221886ea231d, role.id=ec48f4c280dd43db99923e3badf5fe36, scope.project.id=3d2568887e324450bce4edcbb25b94bb) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:02.497064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa142274-3f6d-4c2c-ad9a-5f522211c0cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:02.498547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa142274-3f6d-4c2c-ad9a-5f522211c0cd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:02.506414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 179/366] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 6 04:19:02 2022] GET /identity/v3/role_assignments?group.id=6533b0246a974234a759221886ea231d&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:02.507186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa142274-3f6d-4c2c-ad9a-5f522211c0cd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:02.581353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:02.609178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db42cb-4218-43bc-9c64-ce30391d14ba None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:02.622590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa142274-3f6d-4c2c-ad9a-5f522211c0cd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:02.650135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea4c92-f71b-4e31-8703-2002c3c342c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:02.651211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea4c92-f71b-4e31-8703-2002c3c342c7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.652839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea4c92-f71b-4e31-8703-2002c3c342c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.653393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea4c92-f71b-4e31-8703-2002c3c342c7 None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.654932 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea4c92-f71b-4e31-8703-2002c3c342c7 None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:02.656822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea4c92-f71b-4e31-8703-2002c3c342c7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:02.659246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 188/367] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:02 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:02.665839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea4c92-f71b-4e31-8703-2002c3c342c7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:02.667742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbdc94-7979-4804-aed7-5e6d750642fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:02.668404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbdc94-7979-4804-aed7-5e6d750642fb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.668672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbdc94-7979-4804-aed7-5e6d750642fb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.668940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbdc94-7979-4804-aed7-5e6d750642fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.684199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbdc94-7979-4804-aed7-5e6d750642fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-9adbdc94-7979-4804-aed7-5e6d750642fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:02.691194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:02.692242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:02.693086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 180/368] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:19:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:02.699004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbdc94-7979-4804-aed7-5e6d750642fb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:02.737155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:02.799900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea4c92-f71b-4e31-8703-2002c3c342c7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:02.838131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbdc94-7979-4804-aed7-5e6d750642fb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:02.840018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16b5f-7501-4bdb-878f-8bb6d581e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:02.840949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16b5f-7501-4bdb-878f-8bb6d581e610 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.841435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16b5f-7501-4bdb-878f-8bb6d581e610 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.841931 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16b5f-7501-4bdb-878f-8bb6d581e610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.842865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16b5f-7501-4bdb-878f-8bb6d581e610 None admin] RBAC: Adding query filter params (group.id=6533b0246a974234a759221886ea231d, role.id=ec48f4c280dd43db99923e3badf5fe36, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:02.845988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16b5f-7501-4bdb-878f-8bb6d581e610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:02.847906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16b5f-7501-4bdb-878f-8bb6d581e610 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:02.854766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 189/369] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 6 04:19:02 2022] GET /identity/v3/role_assignments?group.id=6533b0246a974234a759221886ea231d&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:02.861912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16b5f-7501-4bdb-878f-8bb6d581e610 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:02.879741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:02.884820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511a451-ece6-4dfc-80c6-97515ece5d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:02.885448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a451-ece6-4dfc-80c6-97515ece5d6c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:02.885718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a451-ece6-4dfc-80c6-97515ece5d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:02.886815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a451-ece6-4dfc-80c6-97515ece5d6c None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:02.886815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511a451-ece6-4dfc-80c6-97515ece5d6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:02.886989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511a451-ece6-4dfc-80c6-97515ece5d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:02.888390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511a451-ece6-4dfc-80c6-97515ece5d6c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:02.903480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 181/370] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:02.908930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511a451-ece6-4dfc-80c6-97515ece5d6c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:03.011703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16b5f-7501-4bdb-878f-8bb6d581e610 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:03.031790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:03.052853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9784d-46b1-4a46-8456-d4831a023ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:03.053497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9784d-46b1-4a46-8456-d4831a023ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:03.053836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9784d-46b1-4a46-8456-d4831a023ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:03.054024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511a451-ece6-4dfc-80c6-97515ece5d6c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:03.054137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9784d-46b1-4a46-8456-d4831a023ec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:03.065884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9784d-46b1-4a46-8456-d4831a023ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c0a9784d-46b1-4a46-8456-d4831a023ec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:03.071541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:03.072460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:03.073257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:03.074591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 190/371] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:03.083337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9784d-46b1-4a46-8456-d4831a023ec8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:03.124938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bad42-5b46-4597-8f2e-308138ea0561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:03.125894 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bad42-5b46-4597-8f2e-308138ea0561 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:03.126166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bad42-5b46-4597-8f2e-308138ea0561 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:03.126439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bad42-5b46-4597-8f2e-308138ea0561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:03.219673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:03.271870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bad42-5b46-4597-8f2e-308138ea0561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:03.273969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bad42-5b46-4597-8f2e-308138ea0561 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:03.290938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9784d-46b1-4a46-8456-d4831a023ec8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:03.347810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25fce5-da48-4dfe-a6b5-fe0b2ea5560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:03.348434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fce5-da48-4dfe-a6b5-fe0b2ea5560a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:03.348714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fce5-da48-4dfe-a6b5-fe0b2ea5560a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:03.348973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fce5-da48-4dfe-a6b5-fe0b2ea5560a None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:03.349642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25fce5-da48-4dfe-a6b5-fe0b2ea5560a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:03.349940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25fce5-da48-4dfe-a6b5-fe0b2ea5560a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:03.351324 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25fce5-da48-4dfe-a6b5-fe0b2ea5560a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:03.363877 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 191/372] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:03.370357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25fce5-da48-4dfe-a6b5-fe0b2ea5560a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:03.462412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:03.487859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 182/373] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 04:19:03.490774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bad42-5b46-4597-8f2e-308138ea0561 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:03.517789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25fce5-da48-4dfe-a6b5-fe0b2ea5560a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:03.547713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:03.556605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5134f7d-e7e7-40f7-87c7-e18f4c6e4de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:03.557537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5134f7d-e7e7-40f7-87c7-e18f4c6e4de6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:03.558004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5134f7d-e7e7-40f7-87c7-e18f4c6e4de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:03.558479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5134f7d-e7e7-40f7-87c7-e18f4c6e4de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:03.668102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bad42-5b46-4597-8f2e-308138ea0561 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:03.683168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5134f7d-e7e7-40f7-87c7-e18f4c6e4de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:03.684700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5134f7d-e7e7-40f7-87c7-e18f4c6e4de6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:03.741177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772ffde-c7da-4b8c-b1bd-0fdd3078115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:03.743171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772ffde-c7da-4b8c-b1bd-0fdd3078115e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:03.743599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772ffde-c7da-4b8c-b1bd-0fdd3078115e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:03.743985 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772ffde-c7da-4b8c-b1bd-0fdd3078115e None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:03.749321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772ffde-c7da-4b8c-b1bd-0fdd3078115e None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:03.750906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772ffde-c7da-4b8c-b1bd-0fdd3078115e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:03.752619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 183/374] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:03 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:03.758929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772ffde-c7da-4b8c-b1bd-0fdd3078115e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:03.843694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:03.847654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 192/375] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:03.853475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5134f7d-e7e7-40f7-87c7-e18f4c6e4de6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:03.898636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772ffde-c7da-4b8c-b1bd-0fdd3078115e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:03.928851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:03.939044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f52d6-3040-4014-9bd7-aabf72012abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:03.939879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f52d6-3040-4014-9bd7-aabf72012abc None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:03.941037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f52d6-3040-4014-9bd7-aabf72012abc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:03.941429 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f52d6-3040-4014-9bd7-aabf72012abc None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:03.944025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f52d6-3040-4014-9bd7-aabf72012abc None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:03.945775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f52d6-3040-4014-9bd7-aabf72012abc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:03.947978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 184/376] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:03 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:03.954203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f52d6-3040-4014-9bd7-aabf72012abc None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:04.098340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5134f7d-e7e7-40f7-87c7-e18f4c6e4de6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:04.108412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f52d6-3040-4014-9bd7-aabf72012abc None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:04.162035 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:04.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e64bb0-e43d-46f3-8b93-51e4fcc5a4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:04.164741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64bb0-e43d-46f3-8b93-51e4fcc5a4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:04.165045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64bb0-e43d-46f3-8b93-51e4fcc5a4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:04.165403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64bb0-e43d-46f3-8b93-51e4fcc5a4f1 None admin] PATH_INFO: `/v3/projects/8fb2ccd61eb54f9ca99cf78861f2f327` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:04.167403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e64bb0-e43d-46f3-8b93-51e4fcc5a4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=8fb2ccd61eb54f9ca99cf78861f2f327)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:04.168876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e64bb0-e43d-46f3-8b93-51e4fcc5a4f1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:04.172104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 193/377] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:03 2022] GET /identity/v3/projects/8fb2ccd61eb54f9ca99cf78861f2f327 => generated 344 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:04.177136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc1740-c728-4c88-a18c-42f69a94c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:04.178876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e64bb0-e43d-46f3-8b93-51e4fcc5a4f1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:04.179568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc1740-c728-4c88-a18c-42f69a94c91a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:04.179940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc1740-c728-4c88-a18c-42f69a94c91a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:04.180726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc1740-c728-4c88-a18c-42f69a94c91a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:04.182843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc1740-c728-4c88-a18c-42f69a94c91a None admin] RBAC: Adding query filter params (group.id=6533b0246a974234a759221886ea231d, role.id=35a096ec554741cb99e599760e23fe4d, scope.project.id=3d2568887e324450bce4edcbb25b94bb) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:04.183272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc1740-c728-4c88-a18c-42f69a94c91a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:04.185688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc1740-c728-4c88-a18c-42f69a94c91a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:04.200385 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 185/378] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 6 04:19:03 2022] GET /identity/v3/role_assignments?group.id=6533b0246a974234a759221886ea231d&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=35a096ec554741cb99e599760e23fe4d => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:04.295592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:04.300032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e64bb0-e43d-46f3-8b93-51e4fcc5a4f1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:04.339166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593e56e-a777-4b1b-a3ee-ed1ce551573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:04.339851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593e56e-a777-4b1b-a3ee-ed1ce551573b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:04.340122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593e56e-a777-4b1b-a3ee-ed1ce551573b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:04.340388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593e56e-a777-4b1b-a3ee-ed1ce551573b None admin] PATH_INFO: `/v3/groups/f465e084acb841e1a67cea0088b98b75` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:04.347056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593e56e-a777-4b1b-a3ee-ed1ce551573b None admin] RBAC: Authorizing `identity:get_group(group_id=f465e084acb841e1a67cea0088b98b75)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:04.348597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593e56e-a777-4b1b-a3ee-ed1ce551573b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:04.350598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 194/379] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:04 2022] GET /identity/v3/groups/f465e084acb841e1a67cea0088b98b75 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:04.356190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc1740-c728-4c88-a18c-42f69a94c91a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:04.470572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc1740-c728-4c88-a18c-42f69a94c91a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:04.507947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9f4ab-79ae-4e42-96b8-de927750e362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:04.508574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9f4ab-79ae-4e42-96b8-de927750e362 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:04.508846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9f4ab-79ae-4e42-96b8-de927750e362 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:04.509115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9f4ab-79ae-4e42-96b8-de927750e362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:04.509846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9f4ab-79ae-4e42-96b8-de927750e362 None admin] RBAC: Adding query filter params (group.id=f465e084acb841e1a67cea0088b98b75, role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=8fb2ccd61eb54f9ca99cf78861f2f327) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:04.510215 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9f4ab-79ae-4e42-96b8-de927750e362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:04.511759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9f4ab-79ae-4e42-96b8-de927750e362 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:04.518181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 186/380] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 6 04:19:04 2022] GET /identity/v3/role_assignments?group.id=f465e084acb841e1a67cea0088b98b75&scope.project.id=8fb2ccd61eb54f9ca99cf78861f2f327&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:05.297985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89035c0-e6aa-4481-a2ef-4027968baa1a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:05.298525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89035c0-e6aa-4481-a2ef-4027968baa1a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:05.298680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89035c0-e6aa-4481-a2ef-4027968baa1a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:05.300457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 195/381] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:05.306356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34211a6-279c-422d-a9e6-d267882ad46d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:05.306831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34211a6-279c-422d-a9e6-d267882ad46d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:05.307104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34211a6-279c-422d-a9e6-d267882ad46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:05.328386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b34211a6-279c-422d-a9e6-d267882ad46d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:05.329987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b34211a6-279c-422d-a9e6-d267882ad46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:05.375814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:05.399986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 187/382] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:19:05.677337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89035c0-e6aa-4481-a2ef-4027968baa1a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:05.804683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89035c0-e6aa-4481-a2ef-4027968baa1a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:05.847976 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35829ff-5cdf-4161-b77d-b6c94204d598 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:05.848334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35829ff-5cdf-4161-b77d-b6c94204d598 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:05.848514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35829ff-5cdf-4161-b77d-b6c94204d598 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:05.849857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 188/383] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:19:05.852363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c14d-7b4f-40bc-a1cc-a6a2c8d672d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:05.853002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c14d-7b4f-40bc-a1cc-a6a2c8d672d3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:05.853274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c14d-7b4f-40bc-a1cc-a6a2c8d672d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:05.853540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c14d-7b4f-40bc-a1cc-a6a2c8d672d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:05.857871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904c4b-9ed3-4e2a-9e87-7f4539984f97 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:05.858150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904c4b-9ed3-4e2a-9e87-7f4539984f97 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:05.858418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904c4b-9ed3-4e2a-9e87-7f4539984f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:05.877783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132c14d-7b4f-40bc-a1cc-a6a2c8d672d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b132c14d-7b4f-40bc-a1cc-a6a2c8d672d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:05.883152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:05.884071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:05.884862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:05.888343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5d904c4b-9ed3-4e2a-9e87-7f4539984f97 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:05.889534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5d904c4b-9ed3-4e2a-9e87-7f4539984f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:05.891816 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 196/384] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:19:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:05.892664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c14d-7b4f-40bc-a1cc-a6a2c8d672d3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:05.939344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:06.003332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 189/385] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:06.003332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df80f-e79f-4b7c-a91f-d57cbe83f0d1 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:06.003332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df80f-e79f-4b7c-a91f-d57cbe83f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:06.003332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df80f-e79f-4b7c-a91f-d57cbe83f0d1 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:06.003332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 190/386] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:06.005549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272182c-be4a-40b9-94da-1d2f2036bbd5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:06.005834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272182c-be4a-40b9-94da-1d2f2036bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:06.006099 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272182c-be4a-40b9-94da-1d2f2036bbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:06.027474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b272182c-be4a-40b9-94da-1d2f2036bbd5 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:06.028839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b272182c-be4a-40b9-94da-1d2f2036bbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:06.042010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c14d-7b4f-40bc-a1cc-a6a2c8d672d3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:06.113469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68bab7-946e-4a4c-9bf3-dfffc9756ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:06.114388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68bab7-946e-4a4c-9bf3-dfffc9756ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:06.114828 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68bab7-946e-4a4c-9bf3-dfffc9756ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:06.115258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68bab7-946e-4a4c-9bf3-dfffc9756ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:06.116531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68bab7-946e-4a4c-9bf3-dfffc9756ad3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:06.116999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68bab7-946e-4a4c-9bf3-dfffc9756ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:06.118751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68bab7-946e-4a4c-9bf3-dfffc9756ad3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:06.133135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 191/387] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:19:06.133926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 197/388] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:06.140634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272182c-be4a-40b9-94da-1d2f2036bbd5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:06.180785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:06.239488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272182c-be4a-40b9-94da-1d2f2036bbd5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:06.272966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0634a2e-5140-45b9-8dab-1f3be6a0118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:06.273593 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0634a2e-5140-45b9-8dab-1f3be6a0118d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:06.273866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0634a2e-5140-45b9-8dab-1f3be6a0118d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:06.274136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0634a2e-5140-45b9-8dab-1f3be6a0118d None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:06.275271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0634a2e-5140-45b9-8dab-1f3be6a0118d None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:06.276773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0634a2e-5140-45b9-8dab-1f3be6a0118d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:06.278626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 192/389] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:06 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:06.284521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68bab7-946e-4a4c-9bf3-dfffc9756ad3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:06.387283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0634a2e-5140-45b9-8dab-1f3be6a0118d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:06.414691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:06.441772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68bab7-946e-4a4c-9bf3-dfffc9756ad3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:06.499232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a31bd-c708-40cb-91e6-ac47e4685de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:06.499817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a31bd-c708-40cb-91e6-ac47e4685de9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:06.500154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a31bd-c708-40cb-91e6-ac47e4685de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:06.500436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a31bd-c708-40cb-91e6-ac47e4685de9 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:06.502817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a31bd-c708-40cb-91e6-ac47e4685de9 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:06.504665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a31bd-c708-40cb-91e6-ac47e4685de9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:06.507074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 198/390] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:06 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:06.513047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a31bd-c708-40cb-91e6-ac47e4685de9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:06.582680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0634a2e-5140-45b9-8dab-1f3be6a0118d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:06.595669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:06.620294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5ecbe-68ce-4988-9c16-f3e2a4b3df60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:06.621298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5ecbe-68ce-4988-9c16-f3e2a4b3df60 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:06.621901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5ecbe-68ce-4988-9c16-f3e2a4b3df60 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:06.622307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5ecbe-68ce-4988-9c16-f3e2a4b3df60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:06.634205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5ecbe-68ce-4988-9c16-f3e2a4b3df60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-69a5ecbe-68ce-4988-9c16-f3e2a4b3df60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:06.639572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:06.640474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:06.641306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:06.643719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 193/391] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:06.644307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a31bd-c708-40cb-91e6-ac47e4685de9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:06.644845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5ecbe-68ce-4988-9c16-f3e2a4b3df60 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:06.683616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47efe1-071f-4c5e-a819-91cc6802b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:06.684547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47efe1-071f-4c5e-a819-91cc6802b2f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:06.684992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47efe1-071f-4c5e-a819-91cc6802b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:06.685391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47efe1-071f-4c5e-a819-91cc6802b2f1 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/groups/6533b0246a974234a759221886ea231d/roles/35a096ec554741cb99e599760e23fe4d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:06.688710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47efe1-071f-4c5e-a819-91cc6802b2f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa5748b82a34c06a18f092a19b0b6c1, group_id=6533b0246a974234a759221886ea231d, role_id=35a096ec554741cb99e599760e23fe4d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:06.690314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47efe1-071f-4c5e-a819-91cc6802b2f1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:06.706925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 199/392] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Oct 6 04:19:06 2022] PUT /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/groups/6533b0246a974234a759221886ea231d/roles/35a096ec554741cb99e599760e23fe4d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:19:06.708072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47efe1-071f-4c5e-a819-91cc6802b2f1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:06.739929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:06.789483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5ecbe-68ce-4988-9c16-f3e2a4b3df60 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:06.858605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be89bf1-053b-471a-b176-f10837bf11c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:06.859655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be89bf1-053b-471a-b176-f10837bf11c3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:06.861256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be89bf1-053b-471a-b176-f10837bf11c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:06.861747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be89bf1-053b-471a-b176-f10837bf11c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:06.887731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be89bf1-053b-471a-b176-f10837bf11c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-8be89bf1-053b-471a-b176-f10837bf11c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:06.893980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:06.894975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:06.895846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:06.898502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 194/393] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:06.904956 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be89bf1-053b-471a-b176-f10837bf11c3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:06.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:06.965304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47efe1-071f-4c5e-a819-91cc6802b2f1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:07.008373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db412a0-0c30-4ae9-80e6-81c5d1bbb250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:07.009970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db412a0-0c30-4ae9-80e6-81c5d1bbb250 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.010604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db412a0-0c30-4ae9-80e6-81c5d1bbb250 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.011078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db412a0-0c30-4ae9-80e6-81c5d1bbb250 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.011987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db412a0-0c30-4ae9-80e6-81c5d1bbb250 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:07.012505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db412a0-0c30-4ae9-80e6-81c5d1bbb250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:07.014099 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db412a0-0c30-4ae9-80e6-81c5d1bbb250 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:07.025558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 200/394] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:19:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:07.027106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be89bf1-053b-471a-b176-f10837bf11c3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:07.027339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e0753-be4b-4312-89fd-545da60ee4c2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.027806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e0753-be4b-4312-89fd-545da60ee4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.028278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e0753-be4b-4312-89fd-545da60ee4c2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.030613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 201/395] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:07.035389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f104ab-611d-4934-8dce-3be69ede77d4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.035389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f104ab-611d-4934-8dce-3be69ede77d4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.035389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f104ab-611d-4934-8dce-3be69ede77d4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.035389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 202/396] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:07.035389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f104ab-611d-4934-8dce-3be69ede77d4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:07.062922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198cee2-42c5-4265-ab16-ba37a03c9e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:07.063483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198cee2-42c5-4265-ab16-ba37a03c9e39 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.063759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198cee2-42c5-4265-ab16-ba37a03c9e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.064025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198cee2-42c5-4265-ab16-ba37a03c9e39 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.064688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198cee2-42c5-4265-ab16-ba37a03c9e39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:07.064984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198cee2-42c5-4265-ab16-ba37a03c9e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:07.066353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198cee2-42c5-4265-ab16-ba37a03c9e39 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:07.074654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 195/397] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:19:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:07.079806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e11f0-1add-4c6a-a921-4a4defdaa71a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.079806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e11f0-1add-4c6a-a921-4a4defdaa71a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.079806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e11f0-1add-4c6a-a921-4a4defdaa71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.094882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c25e11f0-1add-4c6a-a921-4a4defdaa71a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:07.095772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c25e11f0-1add-4c6a-a921-4a4defdaa71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:07.125615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:07.155897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f104ab-611d-4934-8dce-3be69ede77d4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:07.175820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 196/398] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:07.175820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1474f18-e565-4d02-acf2-ec620b93ba14 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.175820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1474f18-e565-4d02-acf2-ec620b93ba14 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.175820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1474f18-e565-4d02-acf2-ec620b93ba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.195193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d1474f18-e565-4d02-acf2-ec620b93ba14 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:07.196420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d1474f18-e565-4d02-acf2-ec620b93ba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:07.198713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9eec72-391e-44ce-b65b-b9e947039e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:07.200336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9eec72-391e-44ce-b65b-b9e947039e81 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.200613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9eec72-391e-44ce-b65b-b9e947039e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.200883 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9eec72-391e-44ce-b65b-b9e947039e81 None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.202007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9eec72-391e-44ce-b65b-b9e947039e81 None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:07.203514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9eec72-391e-44ce-b65b-b9e947039e81 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:07.207591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 203/399] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:07 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:07.208459 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9eec72-391e-44ce-b65b-b9e947039e81 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:07.214242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:07.290295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 197/400] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:07.291173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1474f18-e565-4d02-acf2-ec620b93ba14 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:07.384598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9eec72-391e-44ce-b65b-b9e947039e81 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:07.406503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1474f18-e565-4d02-acf2-ec620b93ba14 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:07.418697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778121f-76cb-4b63-81ea-46279a7482bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:07.419443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778121f-76cb-4b63-81ea-46279a7482bf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.419635 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778121f-76cb-4b63-81ea-46279a7482bf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.419906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778121f-76cb-4b63-81ea-46279a7482bf None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.421017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778121f-76cb-4b63-81ea-46279a7482bf None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:07.422687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778121f-76cb-4b63-81ea-46279a7482bf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:07.424495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 204/401] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:07 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:07.429963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778121f-76cb-4b63-81ea-46279a7482bf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:07.446907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:07.457117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2504309-cc0b-4e64-9fcf-eb02541536b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:07.458202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2504309-cc0b-4e64-9fcf-eb02541536b6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.458981 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2504309-cc0b-4e64-9fcf-eb02541536b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.459473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2504309-cc0b-4e64-9fcf-eb02541536b6 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.461890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2504309-cc0b-4e64-9fcf-eb02541536b6 None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:07.463693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2504309-cc0b-4e64-9fcf-eb02541536b6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:07.465871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 198/402] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:07 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:07.473898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2504309-cc0b-4e64-9fcf-eb02541536b6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:07.495181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:07.540908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778121f-76cb-4b63-81ea-46279a7482bf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:07.576825 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab1d0-0163-4356-8252-446046ad53e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:07.577394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab1d0-0163-4356-8252-446046ad53e6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.577675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab1d0-0163-4356-8252-446046ad53e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.577948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab1d0-0163-4356-8252-446046ad53e6 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.579631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ab1d0-0163-4356-8252-446046ad53e6 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:07.581221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ab1d0-0163-4356-8252-446046ad53e6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:07.582958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 205/403] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:07 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:07.586660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2504309-cc0b-4e64-9fcf-eb02541536b6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:07.588096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab1d0-0163-4356-8252-446046ad53e6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:07.623810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3c184-4b3f-47b0-a6ed-57c772cfd8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:07.624452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3c184-4b3f-47b0-a6ed-57c772cfd8cf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.624723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3c184-4b3f-47b0-a6ed-57c772cfd8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.625019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3c184-4b3f-47b0-a6ed-57c772cfd8cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.635644 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3c184-4b3f-47b0-a6ed-57c772cfd8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c9e3c184-4b3f-47b0-a6ed-57c772cfd8cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:07.641776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:07.642694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 199/404] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:07.643658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3c184-4b3f-47b0-a6ed-57c772cfd8cf None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:07.681537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:07.706888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab1d0-0163-4356-8252-446046ad53e6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:07.731757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:07.747183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a0ab0-b24a-48f0-93ab-0345527e5feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:07.748110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a0ab0-b24a-48f0-93ab-0345527e5feb None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.748525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a0ab0-b24a-48f0-93ab-0345527e5feb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.748934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a0ab0-b24a-48f0-93ab-0345527e5feb None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb/groups/6533b0246a974234a759221886ea231d/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.751148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a0ab0-b24a-48f0-93ab-0345527e5feb None admin] RBAC: Authorizing `identity:create_grant(project_id=3d2568887e324450bce4edcbb25b94bb, group_id=6533b0246a974234a759221886ea231d, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:07.752762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a0ab0-b24a-48f0-93ab-0345527e5feb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:07.757414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3c184-4b3f-47b0-a6ed-57c772cfd8cf None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:07.768444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 206/405] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Oct 6 04:19:07 2022] PUT /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb/groups/6533b0246a974234a759221886ea231d/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:19:07.769451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a0ab0-b24a-48f0-93ab-0345527e5feb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:07.807161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5b9f8-114e-4d3e-8df6-f15927bfdffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:07.808128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5b9f8-114e-4d3e-8df6-f15927bfdffc None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.808492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5b9f8-114e-4d3e-8df6-f15927bfdffc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.809121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5b9f8-114e-4d3e-8df6-f15927bfdffc None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/groups/6533b0246a974234a759221886ea231d/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:07.812264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5b9f8-114e-4d3e-8df6-f15927bfdffc None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa5748b82a34c06a18f092a19b0b6c1, group_id=6533b0246a974234a759221886ea231d, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:07.814146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5b9f8-114e-4d3e-8df6-f15927bfdffc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:07.839207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 200/406] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Oct 6 04:19:07 2022] PUT /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1/groups/6533b0246a974234a759221886ea231d/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:19:07.839936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5b9f8-114e-4d3e-8df6-f15927bfdffc None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:07.913075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a0ab0-b24a-48f0-93ab-0345527e5feb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:07.993584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dcad1-fa1d-47e7-98ce-fe6f1b393155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:07.994772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dcad1-fa1d-47e7-98ce-fe6f1b393155 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:07.996049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dcad1-fa1d-47e7-98ce-fe6f1b393155 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:07.996641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dcad1-fa1d-47e7-98ce-fe6f1b393155 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:08.016463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:08.026534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dcad1-fa1d-47e7-98ce-fe6f1b393155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8c8dcad1-fa1d-47e7-98ce-fe6f1b393155 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:08.032195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:08.033171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:08.033969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 207/407] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:19:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:08.039570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dcad1-fa1d-47e7-98ce-fe6f1b393155 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:08.041211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5b9f8-114e-4d3e-8df6-f15927bfdffc None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:08.087229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87986812-c608-4c57-bae6-ff87d05e31bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:08.087965 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87986812-c608-4c57-bae6-ff87d05e31bd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:08.088215 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87986812-c608-4c57-bae6-ff87d05e31bd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:08.088484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87986812-c608-4c57-bae6-ff87d05e31bd None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:08.089691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87986812-c608-4c57-bae6-ff87d05e31bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:08.089939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87986812-c608-4c57-bae6-ff87d05e31bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:08.091736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87986812-c608-4c57-bae6-ff87d05e31bd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:08.095129 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:08.104925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 201/408] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:08.111013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87986812-c608-4c57-bae6-ff87d05e31bd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:08.199915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dcad1-fa1d-47e7-98ce-fe6f1b393155 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:08.267231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1189d09-13bb-4dfc-bc58-80f2a1fcfcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:08.267957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1189d09-13bb-4dfc-bc58-80f2a1fcfcda None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:08.268340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1189d09-13bb-4dfc-bc58-80f2a1fcfcda None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:08.268678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1189d09-13bb-4dfc-bc58-80f2a1fcfcda None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:08.269399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1189d09-13bb-4dfc-bc58-80f2a1fcfcda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:08.269764 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1189d09-13bb-4dfc-bc58-80f2a1fcfcda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:08.271293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1189d09-13bb-4dfc-bc58-80f2a1fcfcda None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:08.280247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 208/409] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:08.286214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1189d09-13bb-4dfc-bc58-80f2a1fcfcda None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:08.321125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87986812-c608-4c57-bae6-ff87d05e31bd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:08.371455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:08.408058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87c786-1c2f-41c8-bed2-1cf4f81395cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:08.408742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87c786-1c2f-41c8-bed2-1cf4f81395cf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:08.408984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87c786-1c2f-41c8-bed2-1cf4f81395cf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:08.409250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87c786-1c2f-41c8-bed2-1cf4f81395cf None admin] PATH_INFO: `/v3/groups/f465e084acb841e1a67cea0088b98b75` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:08.410424 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87c786-1c2f-41c8-bed2-1cf4f81395cf None admin] RBAC: Authorizing `identity:get_group(group_id=f465e084acb841e1a67cea0088b98b75)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:08.411903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87c786-1c2f-41c8-bed2-1cf4f81395cf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:08.413820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 202/410] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:08 2022] GET /identity/v3/groups/f465e084acb841e1a67cea0088b98b75 => generated 229 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:08.416586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1189d09-13bb-4dfc-bc58-80f2a1fcfcda None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:08.427797 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87c786-1c2f-41c8-bed2-1cf4f81395cf None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:08.454514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b54015-959b-4eb8-a769-70d2c034050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:08.455247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b54015-959b-4eb8-a769-70d2c034050e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:08.455624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b54015-959b-4eb8-a769-70d2c034050e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:08.456013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b54015-959b-4eb8-a769-70d2c034050e None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:08.457302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b54015-959b-4eb8-a769-70d2c034050e None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:08.458792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b54015-959b-4eb8-a769-70d2c034050e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:08.460874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 209/411] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:08 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:08.470281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b54015-959b-4eb8-a769-70d2c034050e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:08.550822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:08.609234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87c786-1c2f-41c8-bed2-1cf4f81395cf None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:08.660371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3fdf-b141-4daa-abb3-74e43a997262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:08.660926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3fdf-b141-4daa-abb3-74e43a997262 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:08.661198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3fdf-b141-4daa-abb3-74e43a997262 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:08.661535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3fdf-b141-4daa-abb3-74e43a997262 None admin] PATH_INFO: `/v3/projects/8fb2ccd61eb54f9ca99cf78861f2f327` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:08.662798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd3fdf-b141-4daa-abb3-74e43a997262 None admin] RBAC: Authorizing `identity:get_project(project_id=8fb2ccd61eb54f9ca99cf78861f2f327)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:08.664380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd3fdf-b141-4daa-abb3-74e43a997262 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:08.665483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b54015-959b-4eb8-a769-70d2c034050e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:08.666366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 203/412] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:08 2022] GET /identity/v3/projects/8fb2ccd61eb54f9ca99cf78861f2f327 => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:08.677306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3fdf-b141-4daa-abb3-74e43a997262 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:08.719843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:08.740434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac02204-c007-4e5d-ab18-bf805dabb33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:08.741087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02204-c007-4e5d-ab18-bf805dabb33a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:08.741721 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02204-c007-4e5d-ab18-bf805dabb33a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:08.741989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02204-c007-4e5d-ab18-bf805dabb33a None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:08.743156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac02204-c007-4e5d-ab18-bf805dabb33a None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:08.744745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac02204-c007-4e5d-ab18-bf805dabb33a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:08.746550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 210/413] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:08 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:08.754556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac02204-c007-4e5d-ab18-bf805dabb33a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:08.856156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3fdf-b141-4daa-abb3-74e43a997262 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:08.915424 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d48f4-f5ad-48cb-aa9c-a3bf970f8e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:08.916041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d48f4-f5ad-48cb-aa9c-a3bf970f8e36 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:08.916313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d48f4-f5ad-48cb-aa9c-a3bf970f8e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:08.916580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d48f4-f5ad-48cb-aa9c-a3bf970f8e36 None admin] PATH_INFO: `/v3/projects/8fb2ccd61eb54f9ca99cf78861f2f327/groups/f465e084acb841e1a67cea0088b98b75/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:08.918551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d48f4-f5ad-48cb-aa9c-a3bf970f8e36 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fb2ccd61eb54f9ca99cf78861f2f327, group_id=f465e084acb841e1a67cea0088b98b75, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:08.920088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d48f4-f5ad-48cb-aa9c-a3bf970f8e36 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:08.924038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:08.947795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 204/414] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Oct 6 04:19:08 2022] PUT /identity/v3/projects/8fb2ccd61eb54f9ca99cf78861f2f327/groups/f465e084acb841e1a67cea0088b98b75/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:19:08.950324 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac02204-c007-4e5d-ab18-bf805dabb33a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:08.993229 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dbd79-293f-4091-a323-865c99f978f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:08.993910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dbd79-293f-4091-a323-865c99f978f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:08.994184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dbd79-293f-4091-a323-865c99f978f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:08.994455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dbd79-293f-4091-a323-865c99f978f1 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb/groups/6533b0246a974234a759221886ea231d/roles/35a096ec554741cb99e599760e23fe4d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:08.996727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dbd79-293f-4091-a323-865c99f978f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d2568887e324450bce4edcbb25b94bb, group_id=6533b0246a974234a759221886ea231d, role_id=35a096ec554741cb99e599760e23fe4d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:08.998294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dbd79-293f-4091-a323-865c99f978f1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:09.024117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 211/415] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Oct 6 04:19:08 2022] PUT /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb/groups/6533b0246a974234a759221886ea231d/roles/35a096ec554741cb99e599760e23fe4d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:19:09.081483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a1bc3-7443-4dbb-888e-722329792085 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:09.081815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a1bc3-7443-4dbb-888e-722329792085 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:09.082039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a1bc3-7443-4dbb-888e-722329792085 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:09.083924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 205/416] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:09.090015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebec39-89b1-4161-ae3b-71378d49bc57 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:09.090317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebec39-89b1-4161-ae3b-71378d49bc57 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:09.090561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebec39-89b1-4161-ae3b-71378d49bc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:09.111663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9bebec39-89b1-4161-ae3b-71378d49bc57 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:09.112984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9bebec39-89b1-4161-ae3b-71378d49bc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:09.170738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:09.195448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 212/417] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:09.513640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a1bc3-7443-4dbb-888e-722329792085 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:09.645105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a1bc3-7443-4dbb-888e-722329792085 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:09.689241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0648e-aa93-4daf-9c80-f95312d5497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:09.690287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0648e-aa93-4daf-9c80-f95312d5497a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:09.690763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0648e-aa93-4daf-9c80-f95312d5497a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:09.691238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0648e-aa93-4daf-9c80-f95312d5497a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:09.709159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0648e-aa93-4daf-9c80-f95312d5497a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-58f0648e-aa93-4daf-9c80-f95312d5497a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:09.714715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:09.715734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:09.716572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:09.719712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 206/418] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:19:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:09.727340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebec39-89b1-4161-ae3b-71378d49bc57 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:09.871354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebec39-89b1-4161-ae3b-71378d49bc57 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:09.912421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce4290-faab-4cc8-98e7-2301134350a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:09.913046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce4290-faab-4cc8-98e7-2301134350a7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:09.913326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce4290-faab-4cc8-98e7-2301134350a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:09.913595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce4290-faab-4cc8-98e7-2301134350a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:09.914271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce4290-faab-4cc8-98e7-2301134350a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:09.914583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce4290-faab-4cc8-98e7-2301134350a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:09.915999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce4290-faab-4cc8-98e7-2301134350a7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:09.925391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 213/419] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:09.930754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0648e-aa93-4daf-9c80-f95312d5497a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:10.026380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:10.082696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0648e-aa93-4daf-9c80-f95312d5497a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:10.118075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aad47-2707-4442-a201-9831e5b022e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:10.118693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aad47-2707-4442-a201-9831e5b022e8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:10.118971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aad47-2707-4442-a201-9831e5b022e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:10.119240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aad47-2707-4442-a201-9831e5b022e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:10.216333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aad47-2707-4442-a201-9831e5b022e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:10.217877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aad47-2707-4442-a201-9831e5b022e8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:10.288381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:10.345649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 207/420] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:10.351164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce4290-faab-4cc8-98e7-2301134350a7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:10.436626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:10.464539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b28fc-66fd-40e4-a4d2-b4a93bf6235d None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:10.465149 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b28fc-66fd-40e4-a4d2-b4a93bf6235d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:10.465610 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b28fc-66fd-40e4-a4d2-b4a93bf6235d None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:10.471438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 208/421] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:10.473021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be291b-a776-4fa9-ac63-a58cebeb4383 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:10.473560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be291b-a776-4fa9-ac63-a58cebeb4383 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:10.474052 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be291b-a776-4fa9-ac63-a58cebeb4383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:10.493586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-09be291b-a776-4fa9-ac63-a58cebeb4383 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:10.495105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-09be291b-a776-4fa9-ac63-a58cebeb4383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:10.509553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce4290-faab-4cc8-98e7-2301134350a7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:10.575347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779c759-8254-467d-b8e3-caac8f1392c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:10.576438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c759-8254-467d-b8e3-caac8f1392c8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:10.578019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c759-8254-467d-b8e3-caac8f1392c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:10.579279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c759-8254-467d-b8e3-caac8f1392c8 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:10.581869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779c759-8254-467d-b8e3-caac8f1392c8 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:10.585436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779c759-8254-467d-b8e3-caac8f1392c8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:10.588423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 214/422] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:10 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:10.597459 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779c759-8254-467d-b8e3-caac8f1392c8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:10.630756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 209/423] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:19:10.685864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dc370-7bf8-47ac-867a-3110785fc08e None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:10.686490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dc370-7bf8-47ac-867a-3110785fc08e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:10.686988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dc370-7bf8-47ac-867a-3110785fc08e None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:10.689296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 210/424] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:19:10.695792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd330d-f031-4b05-92ad-57aef670c2ff None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:10.696346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd330d-f031-4b05-92ad-57aef670c2ff None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:10.696831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd330d-f031-4b05-92ad-57aef670c2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:10.727412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3edd330d-f031-4b05-92ad-57aef670c2ff None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:10.727412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3edd330d-f031-4b05-92ad-57aef670c2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:10.785628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779c759-8254-467d-b8e3-caac8f1392c8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:10.819472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:10.835531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 211/425] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:10.861779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee87c03-a912-451b-96c8-a32771709087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:10.862680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee87c03-a912-451b-96c8-a32771709087 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:10.863103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee87c03-a912-451b-96c8-a32771709087 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:10.863551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee87c03-a912-451b-96c8-a32771709087 None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:10.867961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee87c03-a912-451b-96c8-a32771709087 None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:10.869588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee87c03-a912-451b-96c8-a32771709087 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:10.871345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 215/426] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:10 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:10.877577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd330d-f031-4b05-92ad-57aef670c2ff None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:10.903652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:11.009864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd330d-f031-4b05-92ad-57aef670c2ff None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:11.019811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee87c03-a912-451b-96c8-a32771709087 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:11.074599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a468f8-5780-4f87-83c8-5e6f97460144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:11.075220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a468f8-5780-4f87-83c8-5e6f97460144 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:11.075519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a468f8-5780-4f87-83c8-5e6f97460144 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:11.075792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a468f8-5780-4f87-83c8-5e6f97460144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:11.077383 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a468f8-5780-4f87-83c8-5e6f97460144 None admin] RBAC: Adding query filter params (group.id=6533b0246a974234a759221886ea231d, role.id=35a096ec554741cb99e599760e23fe4d, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:11.077699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a468f8-5780-4f87-83c8-5e6f97460144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:11.079842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a468f8-5780-4f87-83c8-5e6f97460144 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:11.097565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 212/427] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 6 04:19:10 2022] GET /identity/v3/role_assignments?group.id=6533b0246a974234a759221886ea231d&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=35a096ec554741cb99e599760e23fe4d => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:11.128643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a468f8-5780-4f87-83c8-5e6f97460144 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:11.209503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee87c03-a912-451b-96c8-a32771709087 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:11.274297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c022-62a7-43a3-8df0-351545b99e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:11.275294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c022-62a7-43a3-8df0-351545b99e8b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:11.276008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c022-62a7-43a3-8df0-351545b99e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:11.277490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c022-62a7-43a3-8df0-351545b99e8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:11.288335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:11.309875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4c022-62a7-43a3-8df0-351545b99e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:11.319955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a468f8-5780-4f87-83c8-5e6f97460144 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-63e4c022-62a7-43a3-8df0-351545b99e8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:11.321747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:11.322665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:11.323494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 216/428] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:11.329612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c022-62a7-43a3-8df0-351545b99e8b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:11.364091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663c888-7041-4a2b-b37d-912fa977f7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:11.365110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663c888-7041-4a2b-b37d-912fa977f7da None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:11.365580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663c888-7041-4a2b-b37d-912fa977f7da None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:11.366065 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663c888-7041-4a2b-b37d-912fa977f7da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:11.392055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663c888-7041-4a2b-b37d-912fa977f7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4663c888-7041-4a2b-b37d-912fa977f7da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:11.397616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:11.398535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:11.399369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 213/429] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:11.404786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663c888-7041-4a2b-b37d-912fa977f7da None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:11.414368 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:11.482507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c022-62a7-43a3-8df0-351545b99e8b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:11.520219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e54c6-ffd1-4383-b09a-d1629bad88bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:11.520894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e54c6-ffd1-4383-b09a-d1629bad88bc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:11.521175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e54c6-ffd1-4383-b09a-d1629bad88bc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:11.521484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e54c6-ffd1-4383-b09a-d1629bad88bc None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:11.522247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e54c6-ffd1-4383-b09a-d1629bad88bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:11.522561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e54c6-ffd1-4383-b09a-d1629bad88bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:11.524266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e54c6-ffd1-4383-b09a-d1629bad88bc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:11.533043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663c888-7041-4a2b-b37d-912fa977f7da None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:11.533758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 217/430] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:19:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:11.541961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e54c6-ffd1-4383-b09a-d1629bad88bc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:11.588777 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376417-25bd-428a-b263-77af25b22751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:11.589643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376417-25bd-428a-b263-77af25b22751 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:11.590072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376417-25bd-428a-b263-77af25b22751 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:11.590460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376417-25bd-428a-b263-77af25b22751 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:11.591265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376417-25bd-428a-b263-77af25b22751 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:11.591875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376417-25bd-428a-b263-77af25b22751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:11.593413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376417-25bd-428a-b263-77af25b22751 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:11.602217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:11.607850 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 214/431] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:19:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:11.617688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376417-25bd-428a-b263-77af25b22751 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:11.694679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e54c6-ffd1-4383-b09a-d1629bad88bc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:11.703210 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:11.729706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376417-25bd-428a-b263-77af25b22751 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:11.732916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c7add-0bd8-47d0-a6a4-41358305832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:11.733532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c7add-0bd8-47d0-a6a4-41358305832a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:11.733807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c7add-0bd8-47d0-a6a4-41358305832a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:11.734075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c7add-0bd8-47d0-a6a4-41358305832a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:11.767494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958a930-150f-43c8-a0ad-f4b81f7ea460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:11.768105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a930-150f-43c8-a0ad-f4b81f7ea460 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:11.768382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a930-150f-43c8-a0ad-f4b81f7ea460 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:11.768647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a930-150f-43c8-a0ad-f4b81f7ea460 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:11.803899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c7add-0bd8-47d0-a6a4-41358305832a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:11.805281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c7add-0bd8-47d0-a6a4-41358305832a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:11.837830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:11.840185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a930-150f-43c8-a0ad-f4b81f7ea460 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:11.841804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a930-150f-43c8-a0ad-f4b81f7ea460 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:11.902246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 218/432] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:11.903552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06282d-a175-4baa-aa5e-0e278348d69c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:11.903820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06282d-a175-4baa-aa5e-0e278348d69c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:11.904088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06282d-a175-4baa-aa5e-0e278348d69c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:11.905323 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 219/433] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:11.906519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738615-13b8-44e5-bbda-8bb2f04764ee None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:11.906832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738615-13b8-44e5-bbda-8bb2f04764ee None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:11.907533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738615-13b8-44e5-bbda-8bb2f04764ee None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:11.911363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 220/434] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:11.911363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5738615-13b8-44e5-bbda-8bb2f04764ee None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:11.918638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:11.944901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 215/435] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 04:19:11.946001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac150628-a349-4257-9447-f4cd7e135514 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:11.946281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac150628-a349-4257-9447-f4cd7e135514 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:11.946548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac150628-a349-4257-9447-f4cd7e135514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:11.964003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ac150628-a349-4257-9447-f4cd7e135514 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:11.965204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ac150628-a349-4257-9447-f4cd7e135514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:12.016029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5738615-13b8-44e5-bbda-8bb2f04764ee None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.032012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 216/436] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:12.033212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d5ea6-6022-4553-afce-b52564e0a28c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.033498 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d5ea6-6022-4553-afce-b52564e0a28c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.033767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d5ea6-6022-4553-afce-b52564e0a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.051017 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-bf0d5ea6-6022-4553-afce-b52564e0a28c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:12.052339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bf0d5ea6-6022-4553-afce-b52564e0a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:12.054051 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d504-a1e4-4579-a28e-516d17ebf939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:12.054640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d504-a1e4-4579-a28e-516d17ebf939 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.054911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d504-a1e4-4579-a28e-516d17ebf939 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.055895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d504-a1e4-4579-a28e-516d17ebf939 None admin] PATH_INFO: `/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.056335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d504-a1e4-4579-a28e-516d17ebf939 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa5748b82a34c06a18f092a19b0b6c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:12.057772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d504-a1e4-4579-a28e-516d17ebf939 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:12.064088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 221/437] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:11 2022] GET /identity/v3/projects/9fa5748b82a34c06a18f092a19b0b6c1 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:12.064088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d504-a1e4-4579-a28e-516d17ebf939 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:12.080502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:12.126046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 217/438] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:12.137062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d5ea6-6022-4553-afce-b52564e0a28c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:12.141512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:12.168013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d504-a1e4-4579-a28e-516d17ebf939 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.203162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c819-1171-4a6f-b78b-fb03d06b4858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:12.204198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c819-1171-4a6f-b78b-fb03d06b4858 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.204688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c819-1171-4a6f-b78b-fb03d06b4858 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.205210 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c819-1171-4a6f-b78b-fb03d06b4858 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.206818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21c819-1171-4a6f-b78b-fb03d06b4858 None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:12.208470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21c819-1171-4a6f-b78b-fb03d06b4858 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:12.210280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 222/439] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:12.215823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c819-1171-4a6f-b78b-fb03d06b4858 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:12.263548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d5ea6-6022-4553-afce-b52564e0a28c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.298394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9add9-1d2c-43b6-b858-7addfffbcebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:12.299041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9add9-1d2c-43b6-b858-7addfffbcebb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.299322 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9add9-1d2c-43b6-b858-7addfffbcebb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.299598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9add9-1d2c-43b6-b858-7addfffbcebb None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.300720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9add9-1d2c-43b6-b858-7addfffbcebb None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:12.302174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9add9-1d2c-43b6-b858-7addfffbcebb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:12.307548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 218/440] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:12.308445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9add9-1d2c-43b6-b858-7addfffbcebb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:12.339196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c819-1171-4a6f-b78b-fb03d06b4858 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.340172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:12.374090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64123b0b-2f8a-440b-a65b-1c2e49b0171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:12.374726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64123b0b-2f8a-440b-a65b-1c2e49b0171d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.375055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64123b0b-2f8a-440b-a65b-1c2e49b0171d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.375357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64123b0b-2f8a-440b-a65b-1c2e49b0171d None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.376630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64123b0b-2f8a-440b-a65b-1c2e49b0171d None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:12.378083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64123b0b-2f8a-440b-a65b-1c2e49b0171d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:12.379680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 223/441] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:12.380480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64123b0b-2f8a-440b-a65b-1c2e49b0171d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:12.394868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:12.419469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9add9-1d2c-43b6-b858-7addfffbcebb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.452073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108616f2-1255-48c3-8fe5-7b9a39422a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:12.452697 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108616f2-1255-48c3-8fe5-7b9a39422a4a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.452995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108616f2-1255-48c3-8fe5-7b9a39422a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.453252 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108616f2-1255-48c3-8fe5-7b9a39422a4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.463214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108616f2-1255-48c3-8fe5-7b9a39422a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-108616f2-1255-48c3-8fe5-7b9a39422a4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:12.468523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:12.469652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:12.470622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 219/442] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:12.471684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108616f2-1255-48c3-8fe5-7b9a39422a4a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:12.483056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64123b0b-2f8a-440b-a65b-1c2e49b0171d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.518841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c21db6-1b6b-493a-a3c6-5cb8b68af48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:12.519468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c21db6-1b6b-493a-a3c6-5cb8b68af48e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.519736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c21db6-1b6b-493a-a3c6-5cb8b68af48e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.520010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c21db6-1b6b-493a-a3c6-5cb8b68af48e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.520744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c21db6-1b6b-493a-a3c6-5cb8b68af48e None admin] RBAC: Adding query filter params (group.id=6533b0246a974234a759221886ea231d, role.id=ec48f4c280dd43db99923e3badf5fe36, scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:12.521043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c21db6-1b6b-493a-a3c6-5cb8b68af48e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:12.522468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c21db6-1b6b-493a-a3c6-5cb8b68af48e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:12.528519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 224/443] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/role_assignments?group.id=6533b0246a974234a759221886ea231d&scope.project.id=9fa5748b82a34c06a18f092a19b0b6c1&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:12.529306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c21db6-1b6b-493a-a3c6-5cb8b68af48e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:12.565199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:12.579296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108616f2-1255-48c3-8fe5-7b9a39422a4a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.619635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49683013-8705-4f2c-b926-8f7339874953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:12.620294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49683013-8705-4f2c-b926-8f7339874953 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.620534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49683013-8705-4f2c-b926-8f7339874953 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.620802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49683013-8705-4f2c-b926-8f7339874953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.621549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49683013-8705-4f2c-b926-8f7339874953 None admin] RBAC: Adding query filter params (group.id=6533b0246a974234a759221886ea231d, role.id=ec48f4c280dd43db99923e3badf5fe36, scope.project.id=3d2568887e324450bce4edcbb25b94bb) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:12.621864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49683013-8705-4f2c-b926-8f7339874953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:12.623380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49683013-8705-4f2c-b926-8f7339874953 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:12.629934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 220/444] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/role_assignments?group.id=6533b0246a974234a759221886ea231d&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=ec48f4c280dd43db99923e3badf5fe36 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:12.630812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49683013-8705-4f2c-b926-8f7339874953 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:12.652681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:12.686506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c21db6-1b6b-493a-a3c6-5cb8b68af48e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.743478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ebed-d4b4-4fa1-a0c2-110d085f1f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:12.744140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ebed-d4b4-4fa1-a0c2-110d085f1f80 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.744410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ebed-d4b4-4fa1-a0c2-110d085f1f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.744674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ebed-d4b4-4fa1-a0c2-110d085f1f80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.758314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3ebed-d4b4-4fa1-a0c2-110d085f1f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-12d3ebed-d4b4-4fa1-a0c2-110d085f1f80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:12.765039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:12.766259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:12.767057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 225/445] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:12.773882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49683013-8705-4f2c-b926-8f7339874953 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.774419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ebed-d4b4-4fa1-a0c2-110d085f1f80 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:12.823431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55403a78-4a57-4975-9d03-efe84fe06699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:12.824816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55403a78-4a57-4975-9d03-efe84fe06699 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.824816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55403a78-4a57-4975-9d03-efe84fe06699 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.825113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55403a78-4a57-4975-9d03-efe84fe06699 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.826107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55403a78-4a57-4975-9d03-efe84fe06699 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:12.826107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55403a78-4a57-4975-9d03-efe84fe06699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:12.829109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55403a78-4a57-4975-9d03-efe84fe06699 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:12.839066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 221/446] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:12.845109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55403a78-4a57-4975-9d03-efe84fe06699 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:12.862959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:12.912467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ebed-d4b4-4fa1-a0c2-110d085f1f80 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.952803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3016a3-5a86-4717-97b8-c639f9aef59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:12.953366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3016a3-5a86-4717-97b8-c639f9aef59b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:12.953645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3016a3-5a86-4717-97b8-c639f9aef59b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:12.953917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3016a3-5a86-4717-97b8-c639f9aef59b None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:12.954597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3016a3-5a86-4717-97b8-c639f9aef59b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:12.954901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3016a3-5a86-4717-97b8-c639f9aef59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:12.956340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3016a3-5a86-4717-97b8-c639f9aef59b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:12.958205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:12.965181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55403a78-4a57-4975-9d03-efe84fe06699 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:12.967379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 226/447] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:12.972583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3016a3-5a86-4717-97b8-c639f9aef59b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:13.007997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e8efa-0b92-4535-a474-e8a3177f3c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:13.008615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e8efa-0b92-4535-a474-e8a3177f3c43 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:13.008889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e8efa-0b92-4535-a474-e8a3177f3c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:13.009155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e8efa-0b92-4535-a474-e8a3177f3c43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:13.086002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e8efa-0b92-4535-a474-e8a3177f3c43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:13.087656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e8efa-0b92-4535-a474-e8a3177f3c43 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:13.090200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3016a3-5a86-4717-97b8-c639f9aef59b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:13.103703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:13.136456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8bd03-b184-4530-b3ec-994a05c712dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:13.137077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8bd03-b184-4530-b3ec-994a05c712dd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:13.137354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8bd03-b184-4530-b3ec-994a05c712dd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:13.137619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8bd03-b184-4530-b3ec-994a05c712dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:13.208282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:13.208476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 222/448] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:13.213889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e8efa-0b92-4535-a474-e8a3177f3c43 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:13.214954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8bd03-b184-4530-b3ec-994a05c712dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:13.216974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8bd03-b184-4530-b3ec-994a05c712dd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:13.325971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e8efa-0b92-4535-a474-e8a3177f3c43 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:13.337456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 227/449] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 04:19:13.340963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:13.342911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8bd03-b184-4530-b3ec-994a05c712dd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:13.362009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019263b3-d4c7-4180-8e2b-a8742175b008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:13.362635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019263b3-d4c7-4180-8e2b-a8742175b008 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:13.362913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019263b3-d4c7-4180-8e2b-a8742175b008 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:13.363611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019263b3-d4c7-4180-8e2b-a8742175b008 None admin] PATH_INFO: `/v3/projects/3d2568887e324450bce4edcbb25b94bb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:13.364727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019263b3-d4c7-4180-8e2b-a8742175b008 None admin] RBAC: Authorizing `identity:get_project(project_id=3d2568887e324450bce4edcbb25b94bb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:13.366525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019263b3-d4c7-4180-8e2b-a8742175b008 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:13.368327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 223/450] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:13 2022] GET /identity/v3/projects/3d2568887e324450bce4edcbb25b94bb => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:13.373737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019263b3-d4c7-4180-8e2b-a8742175b008 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:13.433845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:13.440952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8bd03-b184-4530-b3ec-994a05c712dd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:13.471284 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019263b3-d4c7-4180-8e2b-a8742175b008 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:13.474010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31484275-ef93-4728-9e6e-a0ba4f3a8797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:13.474641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31484275-ef93-4728-9e6e-a0ba4f3a8797 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:13.474918 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31484275-ef93-4728-9e6e-a0ba4f3a8797 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:13.475184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31484275-ef93-4728-9e6e-a0ba4f3a8797 None admin] PATH_INFO: `/v3/projects/8fb2ccd61eb54f9ca99cf78861f2f327` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:13.476338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31484275-ef93-4728-9e6e-a0ba4f3a8797 None admin] RBAC: Authorizing `identity:get_project(project_id=8fb2ccd61eb54f9ca99cf78861f2f327)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:13.477798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31484275-ef93-4728-9e6e-a0ba4f3a8797 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:13.479588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 228/451] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:19:13 2022] GET /identity/v3/projects/8fb2ccd61eb54f9ca99cf78861f2f327 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:13.484961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31484275-ef93-4728-9e6e-a0ba4f3a8797 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:13.504746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5752d8-2cbd-4d05-8899-ccac5a196c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:13.505377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5752d8-2cbd-4d05-8899-ccac5a196c81 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:13.505652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5752d8-2cbd-4d05-8899-ccac5a196c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:13.505925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5752d8-2cbd-4d05-8899-ccac5a196c81 None admin] PATH_INFO: `/v3/groups/6533b0246a974234a759221886ea231d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:13.507045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5752d8-2cbd-4d05-8899-ccac5a196c81 None admin] RBAC: Authorizing `identity:get_group(group_id=6533b0246a974234a759221886ea231d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:13.508552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5752d8-2cbd-4d05-8899-ccac5a196c81 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:13.510253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 224/452] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:13 2022] GET /identity/v3/groups/6533b0246a974234a759221886ea231d => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:13.516051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5752d8-2cbd-4d05-8899-ccac5a196c81 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:13.564342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:13.581604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31484275-ef93-4728-9e6e-a0ba4f3a8797 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:13.614288 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5752d8-2cbd-4d05-8899-ccac5a196c81 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:13.616944 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611d486-5d83-4fec-9566-a76bcdd94864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:13.617583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611d486-5d83-4fec-9566-a76bcdd94864 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:13.617860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611d486-5d83-4fec-9566-a76bcdd94864 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:13.618125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611d486-5d83-4fec-9566-a76bcdd94864 None admin] PATH_INFO: `/v3/groups/f465e084acb841e1a67cea0088b98b75` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:13.619272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611d486-5d83-4fec-9566-a76bcdd94864 None admin] RBAC: Authorizing `identity:get_group(group_id=f465e084acb841e1a67cea0088b98b75)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:13.620735 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611d486-5d83-4fec-9566-a76bcdd94864 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:13.622306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 229/453] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Oct 6 04:19:13 2022] GET /identity/v3/groups/f465e084acb841e1a67cea0088b98b75 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:13.628354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611d486-5d83-4fec-9566-a76bcdd94864 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:13.647855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a61c7-0065-4342-9720-723adcb5f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:13.648455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a61c7-0065-4342-9720-723adcb5f253 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:13.648726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a61c7-0065-4342-9720-723adcb5f253 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:13.648992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a61c7-0065-4342-9720-723adcb5f253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:13.649706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a61c7-0065-4342-9720-723adcb5f253 None admin] RBAC: Adding query filter params (group.id=6533b0246a974234a759221886ea231d, role.id=35a096ec554741cb99e599760e23fe4d, scope.project.id=3d2568887e324450bce4edcbb25b94bb) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:13.650011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a61c7-0065-4342-9720-723adcb5f253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:13.651485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a61c7-0065-4342-9720-723adcb5f253 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:13.657016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 225/454] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 6 04:19:13 2022] GET /identity/v3/role_assignments?group.id=6533b0246a974234a759221886ea231d&scope.project.id=3d2568887e324450bce4edcbb25b94bb&role.id=35a096ec554741cb99e599760e23fe4d => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:13.659501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:13.735502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611d486-5d83-4fec-9566-a76bcdd94864 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:13.773005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2057d-914f-41d4-809d-d446211ea150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:13.773627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2057d-914f-41d4-809d-d446211ea150 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:13.773875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2057d-914f-41d4-809d-d446211ea150 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:13.774198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2057d-914f-41d4-809d-d446211ea150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:13.774937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2057d-914f-41d4-809d-d446211ea150 None admin] RBAC: Adding query filter params (group.id=f465e084acb841e1a67cea0088b98b75, role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=8fb2ccd61eb54f9ca99cf78861f2f327) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:13.775245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2057d-914f-41d4-809d-d446211ea150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:13.776740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2057d-914f-41d4-809d-d446211ea150 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:13.783295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 230/455] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Oct 6 04:19:13 2022] GET /identity/v3/role_assignments?group.id=f465e084acb841e1a67cea0088b98b75&scope.project.id=8fb2ccd61eb54f9ca99cf78861f2f327&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:16.405867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45d03a-1f99-4352-bdd9-56bc7950bd85 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:16.406576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45d03a-1f99-4352-bdd9-56bc7950bd85 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:16.406576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45d03a-1f99-4352-bdd9-56bc7950bd85 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:16.408078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 226/456] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:16.414014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305995be-80b2-428b-8990-bf5a98c05356 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:16.414955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305995be-80b2-428b-8990-bf5a98c05356 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:16.415480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305995be-80b2-428b-8990-bf5a98c05356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:16.442843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-305995be-80b2-428b-8990-bf5a98c05356 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:16.444477 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-305995be-80b2-428b-8990-bf5a98c05356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:16.528337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 231/457] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:16.532992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b891-206b-4702-86d7-68e32e53b78f None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:16.533515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b891-206b-4702-86d7-68e32e53b78f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:16.533997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b891-206b-4702-86d7-68e32e53b78f None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:16.535763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 227/458] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:16.540553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c59579-f0bc-4a86-84fa-6bad6a193760 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:16.540802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c59579-f0bc-4a86-84fa-6bad6a193760 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:16.541073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c59579-f0bc-4a86-84fa-6bad6a193760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:16.563581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-85c59579-f0bc-4a86-84fa-6bad6a193760 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:16.564766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-85c59579-f0bc-4a86-84fa-6bad6a193760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:16.593353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:16.648227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 232/459] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:19:16.784053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a22fc-ec17-4ec1-9d9f-82c2bf198450 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:16.784680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a22fc-ec17-4ec1-9d9f-82c2bf198450 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:16.785165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a22fc-ec17-4ec1-9d9f-82c2bf198450 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:16.786940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 228/460] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:16.792183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e79d9-c99a-4424-b9f1-7fc9fcd8073a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:16.792470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e79d9-c99a-4424-b9f1-7fc9fcd8073a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:16.792746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e79d9-c99a-4424-b9f1-7fc9fcd8073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:16.815548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e23e79d9-c99a-4424-b9f1-7fc9fcd8073a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:16.816741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e23e79d9-c99a-4424-b9f1-7fc9fcd8073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:16.897835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 233/461] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:16.939343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a22fc-ec17-4ec1-9d9f-82c2bf198450 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:17.063599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a22fc-ec17-4ec1-9d9f-82c2bf198450 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:17.087690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:17.099953 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e79d9-c99a-4424-b9f1-7fc9fcd8073a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:17.109646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc8e2-94ec-466d-b809-1b00a2eea69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:17.109646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc8e2-94ec-466d-b809-1b00a2eea69f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:17.109646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc8e2-94ec-466d-b809-1b00a2eea69f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:17.109646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc8e2-94ec-466d-b809-1b00a2eea69f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:17.131180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fc8e2-94ec-466d-b809-1b00a2eea69f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:17.134357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fc8e2-94ec-466d-b809-1b00a2eea69f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f05fc8e2-94ec-466d-b809-1b00a2eea69f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:17.161689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:17.162732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:17.163619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:17.163619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:17.163619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:17.163619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 229/462] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:17.168851 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc8e2-94ec-466d-b809-1b00a2eea69f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:17.217874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:17.237961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e79d9-c99a-4424-b9f1-7fc9fcd8073a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:17.285727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addb0c2-4fcb-49bf-9ad3-711ef62a2891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:17.286796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb0c2-4fcb-49bf-9ad3-711ef62a2891 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:17.287269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb0c2-4fcb-49bf-9ad3-711ef62a2891 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:17.287755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb0c2-4fcb-49bf-9ad3-711ef62a2891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:17.301981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addb0c2-4fcb-49bf-9ad3-711ef62a2891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:17.304227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addb0c2-4fcb-49bf-9ad3-711ef62a2891 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:17.325867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc8e2-94ec-466d-b809-1b00a2eea69f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3addb0c2-4fcb-49bf-9ad3-711ef62a2891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:17.326314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:17.327255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:17.328943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:17.328943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:17.328943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:17.328943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 234/463] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:17.328943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addb0c2-4fcb-49bf-9ad3-711ef62a2891 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:17.383552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5552c95-5425-490e-a539-3ee903f60204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:17.384167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5552c95-5425-490e-a539-3ee903f60204 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:17.384438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5552c95-5425-490e-a539-3ee903f60204 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:17.384701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5552c95-5425-490e-a539-3ee903f60204 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:17.385346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5552c95-5425-490e-a539-3ee903f60204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:17.385640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5552c95-5425-490e-a539-3ee903f60204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:17.387008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5552c95-5425-490e-a539-3ee903f60204 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:17.399094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 230/464] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:17.399911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5552c95-5425-490e-a539-3ee903f60204 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:17.427671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:17.453140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addb0c2-4fcb-49bf-9ad3-711ef62a2891 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:17.489335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9adf5f-6925-4f64-b424-769de4ccc865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:17.489971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9adf5f-6925-4f64-b424-769de4ccc865 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:17.490243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9adf5f-6925-4f64-b424-769de4ccc865 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:17.490498 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9adf5f-6925-4f64-b424-769de4ccc865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:17.498438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:17.502588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9adf5f-6925-4f64-b424-769de4ccc865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:17.504338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9adf5f-6925-4f64-b424-769de4ccc865 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:17.510617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5552c95-5425-490e-a539-3ee903f60204 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-be9adf5f-6925-4f64-b424-769de4ccc865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:17.520526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:17.521451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:17.522287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:17.522287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:17.522287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:17.522287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 235/465] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:17.522837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3739c1-3891-437d-9d22-a11ad40cff3e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:17.523117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3739c1-3891-437d-9d22-a11ad40cff3e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:17.523408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3739c1-3891-437d-9d22-a11ad40cff3e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:17.527223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 236/466] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:17.527223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3739c1-3891-437d-9d22-a11ad40cff3e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:17.553737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c15a7a-2118-4912-b0b6-53924675a82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:17.554349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c15a7a-2118-4912-b0b6-53924675a82a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:17.554679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c15a7a-2118-4912-b0b6-53924675a82a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:17.554956 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c15a7a-2118-4912-b0b6-53924675a82a None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:17.555665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c15a7a-2118-4912-b0b6-53924675a82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:17.555974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c15a7a-2118-4912-b0b6-53924675a82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:17.557381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c15a7a-2118-4912-b0b6-53924675a82a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:17.570645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 231/467] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:17.571580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c15a7a-2118-4912-b0b6-53924675a82a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:17.633069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3739c1-3891-437d-9d22-a11ad40cff3e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:17.669411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b62bb-6e8e-4c06-aa85-2524cef0369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:17.669765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:17.669997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b62bb-6e8e-4c06-aa85-2524cef0369c None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:17.670271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b62bb-6e8e-4c06-aa85-2524cef0369c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:17.670577 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b62bb-6e8e-4c06-aa85-2524cef0369c None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:17.671525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b62bb-6e8e-4c06-aa85-2524cef0369c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:17.673110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b62bb-6e8e-4c06-aa85-2524cef0369c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:17.686759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c15a7a-2118-4912-b0b6-53924675a82a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:17.696605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 237/468] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:19:17 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:19:17.697935 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777afd-29b2-474f-9e1d-c2367df66577 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:17.698222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777afd-29b2-474f-9e1d-c2367df66577 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:17.698495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777afd-29b2-474f-9e1d-c2367df66577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:17.718265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f7777afd-29b2-474f-9e1d-c2367df66577 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:17.719880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f7777afd-29b2-474f-9e1d-c2367df66577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:17.736539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00e6eb-e32f-4867-a42f-c2639b383ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:17.737601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00e6eb-e32f-4867-a42f-c2639b383ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:17.738045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00e6eb-e32f-4867-a42f-c2639b383ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:17.738492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00e6eb-e32f-4867-a42f-c2639b383ed2 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:17.739374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00e6eb-e32f-4867-a42f-c2639b383ed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:17.739865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00e6eb-e32f-4867-a42f-c2639b383ed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:17.741838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00e6eb-e32f-4867-a42f-c2639b383ed2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:17.759723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 232/469] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:17.760826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00e6eb-e32f-4867-a42f-c2639b383ed2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:17.769712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:17.811798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 238/470] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:17.812946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777afd-29b2-474f-9e1d-c2367df66577 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:17.903468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00e6eb-e32f-4867-a42f-c2639b383ed2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:17.953915 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0198e-746f-4b45-b7e5-782beacb23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:17.955333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0198e-746f-4b45-b7e5-782beacb23e3 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:17.955811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0198e-746f-4b45-b7e5-782beacb23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:17.956563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0198e-746f-4b45-b7e5-782beacb23e3 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:17.957465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0198e-746f-4b45-b7e5-782beacb23e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:17.960131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0198e-746f-4b45-b7e5-782beacb23e3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:17.985888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777afd-29b2-474f-9e1d-c2367df66577 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:17.994617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 233/471] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:19:17 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:19:18.036396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e7146-9214-44fc-b3d6-f3c2be864f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:18.037435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e7146-9214-44fc-b3d6-f3c2be864f17 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:18.037960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e7146-9214-44fc-b3d6-f3c2be864f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:18.038425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e7146-9214-44fc-b3d6-f3c2be864f17 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:18.039350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e7146-9214-44fc-b3d6-f3c2be864f17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:18.041098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e7146-9214-44fc-b3d6-f3c2be864f17 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:18.067641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 239/472] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:19:17 2022] POST /identity/v3/users => generated 248 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:19:18.111506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6586732-2523-4186-a930-156008956a71 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:18.112209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6586732-2523-4186-a930-156008956a71 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:18.112686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6586732-2523-4186-a930-156008956a71 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:18.114411 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 234/473] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:18.121050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3674ad-04dd-4f93-939c-3e49fd6d3bd0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:18.121799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3674ad-04dd-4f93-939c-3e49fd6d3bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:18.122281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3674ad-04dd-4f93-939c-3e49fd6d3bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:18.144534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9d3674ad-04dd-4f93-939c-3e49fd6d3bd0 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:18.146222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9d3674ad-04dd-4f93-939c-3e49fd6d3bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:18.174117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6586732-2523-4186-a930-156008956a71 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:18.177699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:18.195822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:18.251612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 240/474] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:18.324975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6586732-2523-4186-a930-156008956a71 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:18.366789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140723d-fd33-40e8-9af6-e682ecafcaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:18.367458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140723d-fd33-40e8-9af6-e682ecafcaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:18.368013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140723d-fd33-40e8-9af6-e682ecafcaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:18.368286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140723d-fd33-40e8-9af6-e682ecafcaf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:18.379627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140723d-fd33-40e8-9af6-e682ecafcaf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:18.381094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140723d-fd33-40e8-9af6-e682ecafcaf4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c140723d-fd33-40e8-9af6-e682ecafcaf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:18.397021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:18.397953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:18.398831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:18.398831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:18.398831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:18.398831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 235/475] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:18.404725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3674ad-04dd-4f93-939c-3e49fd6d3bd0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:18.520674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3674ad-04dd-4f93-939c-3e49fd6d3bd0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:18.544514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140723d-fd33-40e8-9af6-e682ecafcaf4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:18.554808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a688a-ccdd-478f-b994-fcd7bc0b64fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:18.555846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a688a-ccdd-478f-b994-fcd7bc0b64fe None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:18.555846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a688a-ccdd-478f-b994-fcd7bc0b64fe None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:18.556039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a688a-ccdd-478f-b994-fcd7bc0b64fe None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:18.556613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a688a-ccdd-478f-b994-fcd7bc0b64fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:18.556898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a688a-ccdd-478f-b994-fcd7bc0b64fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:18.558269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a688a-ccdd-478f-b994-fcd7bc0b64fe None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:18.570514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 241/476] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:18.575752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a688a-ccdd-478f-b994-fcd7bc0b64fe None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:18.600687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:18.647851 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:18.678123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a688a-ccdd-478f-b994-fcd7bc0b64fe None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:18.713600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7f718-b158-400b-a1c6-0f45c3d79326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:18.714208 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f718-b158-400b-a1c6-0f45c3d79326 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:18.714480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f718-b158-400b-a1c6-0f45c3d79326 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:18.714742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f718-b158-400b-a1c6-0f45c3d79326 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:18.715424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7f718-b158-400b-a1c6-0f45c3d79326 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:18.717052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7f718-b158-400b-a1c6-0f45c3d79326 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:18.729611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140723d-fd33-40e8-9af6-e682ecafcaf4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:18.746613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 242/477] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:19:18 2022] POST /identity/v3/users => generated 249 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:19:18.789087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba9611-6946-4ce0-85fc-8f10939c7bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:18.789617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9611-6946-4ce0-85fc-8f10939c7bb1 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:18.789889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9611-6946-4ce0-85fc-8f10939c7bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:18.790152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9611-6946-4ce0-85fc-8f10939c7bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:18.790826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba9611-6946-4ce0-85fc-8f10939c7bb1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:18.792383 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba9611-6946-4ce0-85fc-8f10939c7bb1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:18.801609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.sql.core [None req-12ba9611-6946-4ce0-85fc-8f10939c7bb1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 06 04:19:18.801609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 06 04:19:18.801609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [parameters: {'id': '02c8199593b44acb9892a6f4841f5cbb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 06 04:19:18.801609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81436) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-12ba9611-6946-4ce0-85fc-8f10939c7bb1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application conn.query(q) Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result.read() Oct 06 04:19:18.820331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return ref.to_dict() Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 04:19:18.821276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application next(self.gen) Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application yield resource Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application next(self.gen) Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.session.rollback() Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.force_reraise() Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise self.value Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application session.commit() Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 06 04:19:18.822673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._prepare_impl() Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.session.flush() Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._flush(objects) Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application compat.raise_( Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application flush_context.execute() Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rec.execute(self) Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 04:19:18.823913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 04:19:18.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application conn.query(q) Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result.read() Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 04:19:18.826137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [parameters: {'id': '02c8199593b44acb9892a6f4841f5cbb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:18.832234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 06 04:19:18.834163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:18.836173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 236/478] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Oct 6 04:19:18 2022] POST /identity/v3/roles => generated 144 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:18.836308 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7f718-b158-400b-a1c6-0f45c3d79326 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:18.952032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:18.977645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7f718-b158-400b-a1c6-0f45c3d79326 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:19.014835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437d0b7-ab8d-4e94-9272-ad6ecb774db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:19.015990 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437d0b7-ab8d-4e94-9272-ad6ecb774db9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:19.016477 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437d0b7-ab8d-4e94-9272-ad6ecb774db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:19.016938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437d0b7-ab8d-4e94-9272-ad6ecb774db9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:19.027939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437d0b7-ab8d-4e94-9272-ad6ecb774db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c437d0b7-ab8d-4e94-9272-ad6ecb774db9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:19.033881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:19.034783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 04:19:19.035717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:19.038027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 243/479] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:19:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:19.044502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba9611-6946-4ce0-85fc-8f10939c7bb1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:19.158908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba9611-6946-4ce0-85fc-8f10939c7bb1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:19.177319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:19.194959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6086815-b256-4910-a126-f17a2be20241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:19.195709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6086815-b256-4910-a126-f17a2be20241 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:19.195981 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6086815-b256-4910-a126-f17a2be20241 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:19.196244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6086815-b256-4910-a126-f17a2be20241 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:19.197075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6086815-b256-4910-a126-f17a2be20241 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:19.197370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6086815-b256-4910-a126-f17a2be20241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:19.199051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6086815-b256-4910-a126-f17a2be20241 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:19.209468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 237/480] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:20.510999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cec21-98c0-45c3-9d35-7e7f334f472b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:20.511578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cec21-98c0-45c3-9d35-7e7f334f472b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:20.511578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cec21-98c0-45c3-9d35-7e7f334f472b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:20.513168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 244/481] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:20.519084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ecdf9-31e8-4875-baa7-15c55e8e6148 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:20.519539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ecdf9-31e8-4875-baa7-15c55e8e6148 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:20.519634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ecdf9-31e8-4875-baa7-15c55e8e6148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:20.548397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-201ecdf9-31e8-4875-baa7-15c55e8e6148 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:20.549621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-201ecdf9-31e8-4875-baa7-15c55e8e6148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:20.576072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881db2ce-1ded-4c29-a774-9958d1e02917 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:20.576317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881db2ce-1ded-4c29-a774-9958d1e02917 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:20.576815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881db2ce-1ded-4c29-a774-9958d1e02917 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:20.578461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 245/482] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:20.584157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f74ba-e0c3-424e-880b-ab8e2c0842cc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:20.584436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f74ba-e0c3-424e-880b-ab8e2c0842cc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:20.584708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f74ba-e0c3-424e-880b-ab8e2c0842cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:20.615455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a60f74ba-e0c3-424e-880b-ab8e2c0842cc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:20.617016 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a60f74ba-e0c3-424e-880b-ab8e2c0842cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:20.633561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 238/483] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:20.710818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 246/484] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:19:21.004327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242813e-866a-4f7c-9d55-c93ca51b8bbf None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.004903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242813e-866a-4f7c-9d55-c93ca51b8bbf None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.005372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242813e-866a-4f7c-9d55-c93ca51b8bbf None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.007150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 239/485] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:21.012027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fcdff-879d-4ee1-aa82-f0c69a5c5c90 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.012519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fcdff-879d-4ee1-aa82-f0c69a5c5c90 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.012986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fcdff-879d-4ee1-aa82-f0c69a5c5c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.016083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f74ba-e0c3-424e-880b-ab8e2c0842cc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:21.040133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-fe7fcdff-879d-4ee1-aa82-f0c69a5c5c90 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:21.042881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fe7fcdff-879d-4ee1-aa82-f0c69a5c5c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:21.119241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:21.145315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 240/486] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:21.146036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fcdff-879d-4ee1-aa82-f0c69a5c5c90 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:21.180091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f74ba-e0c3-424e-880b-ab8e2c0842cc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:21.227677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:21.251198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0653db5-b62c-4204-adda-0cabedc9927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:21.251881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0653db5-b62c-4204-adda-0cabedc9927a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.252155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0653db5-b62c-4204-adda-0cabedc9927a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.252422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0653db5-b62c-4204-adda-0cabedc9927a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.266351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0653db5-b62c-4204-adda-0cabedc9927a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f0653db5-b62c-4204-adda-0cabedc9927a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:21.271140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:21.272075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:21.272872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 247/487] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:21.279584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0653db5-b62c-4204-adda-0cabedc9927a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:21.349458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fcdff-879d-4ee1-aa82-f0c69a5c5c90 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:21.419557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0653db5-b62c-4204-adda-0cabedc9927a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:21.428022 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9798b8c-6aaf-4ef1-b373-adc13ec0153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:21.428671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9798b8c-6aaf-4ef1-b373-adc13ec0153d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.428949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9798b8c-6aaf-4ef1-b373-adc13ec0153d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.429217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9798b8c-6aaf-4ef1-b373-adc13ec0153d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.447152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:21.448714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9798b8c-6aaf-4ef1-b373-adc13ec0153d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c9798b8c-6aaf-4ef1-b373-adc13ec0153d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:21.456912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:21.457858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:21.458672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 241/488] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:21.463755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9798b8c-6aaf-4ef1-b373-adc13ec0153d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:21.470113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193d54c-1f31-4ecd-9a98-f88acb6eed80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:21.470991 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193d54c-1f31-4ecd-9a98-f88acb6eed80 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.475545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193d54c-1f31-4ecd-9a98-f88acb6eed80 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.475969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193d54c-1f31-4ecd-9a98-f88acb6eed80 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.476856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193d54c-1f31-4ecd-9a98-f88acb6eed80 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:21.477295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193d54c-1f31-4ecd-9a98-f88acb6eed80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:21.478818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193d54c-1f31-4ecd-9a98-f88acb6eed80 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:21.489579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 248/489] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:21.490660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193d54c-1f31-4ecd-9a98-f88acb6eed80 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:21.584504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:21.589924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9798b8c-6aaf-4ef1-b373-adc13ec0153d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:21.599671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193d54c-1f31-4ecd-9a98-f88acb6eed80 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:21.636080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b315729-39ab-470d-bb96-1c2d668b416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:21.637299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b315729-39ab-470d-bb96-1c2d668b416f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.637789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b315729-39ab-470d-bb96-1c2d668b416f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.638248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b315729-39ab-470d-bb96-1c2d668b416f None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.639102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b315729-39ab-470d-bb96-1c2d668b416f None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:21.639610 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b315729-39ab-470d-bb96-1c2d668b416f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:21.640711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb4509-942c-436e-9b05-732ce4566b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:21.641428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb4509-942c-436e-9b05-732ce4566b91 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.641702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb4509-942c-436e-9b05-732ce4566b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.641969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb4509-942c-436e-9b05-732ce4566b91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.642339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b315729-39ab-470d-bb96-1c2d668b416f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:21.653217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 242/490] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:21.654382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b315729-39ab-470d-bb96-1c2d668b416f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:21.657822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb4509-942c-436e-9b05-732ce4566b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-45bb4509-942c-436e-9b05-732ce4566b91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:21.664030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:21.664987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:21.666366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 249/491] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:21.667079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa5ef-01a3-4679-a2bd-7fec9f84c44e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.667079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa5ef-01a3-4679-a2bd-7fec9f84c44e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.667079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa5ef-01a3-4679-a2bd-7fec9f84c44e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.669137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 250/492] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:21.669249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa5ef-01a3-4679-a2bd-7fec9f84c44e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:21.722565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:21.771619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b315729-39ab-470d-bb96-1c2d668b416f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:21.785434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa5ef-01a3-4679-a2bd-7fec9f84c44e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:21.807467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1d203-6130-4a7f-b3b9-e6a17bd3bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:21.808109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1d203-6130-4a7f-b3b9-e6a17bd3bf1d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.808384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1d203-6130-4a7f-b3b9-e6a17bd3bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.808650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1d203-6130-4a7f-b3b9-e6a17bd3bf1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.819526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1d203-6130-4a7f-b3b9-e6a17bd3bf1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:21.821529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1d203-6130-4a7f-b3b9-e6a17bd3bf1d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:21.829137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf393a-3dd8-4f33-92f0-ff9a6868f99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:21.830003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf393a-3dd8-4f33-92f0-ff9a6868f99b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.830450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf393a-3dd8-4f33-92f0-ff9a6868f99b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.830859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf393a-3dd8-4f33-92f0-ff9a6868f99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-67e1d203-6130-4a7f-b3b9-e6a17bd3bf1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:21.835640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:21.836694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:21.837553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:21.837553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:21.837553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:21.837553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 243/493] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:21.837553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1d203-6130-4a7f-b3b9-e6a17bd3bf1d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:21.845942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf393a-3dd8-4f33-92f0-ff9a6868f99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:21.847609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf393a-3dd8-4f33-92f0-ff9a6868f99b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:21.857224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f9bf393a-3dd8-4f33-92f0-ff9a6868f99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:21.865006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:21.866068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:21.867463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:21.867463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:21.867463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:21.869345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 251/494] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:21.870958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7a074-10cc-454c-ac20-6a5d07810b36 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:21.871389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7a074-10cc-454c-ac20-6a5d07810b36 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:21.871805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7a074-10cc-454c-ac20-6a5d07810b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:21.893146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b2c7a074-10cc-454c-ac20-6a5d07810b36 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:21.894579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b2c7a074-10cc-454c-ac20-6a5d07810b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:21.953134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1d203-6130-4a7f-b3b9-e6a17bd3bf1d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:21.965109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 252/495] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:21.966042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7a074-10cc-454c-ac20-6a5d07810b36 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.002059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:22.008423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff791e-f434-469c-abb3-95a29f99c68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.009037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff791e-f434-469c-abb3-95a29f99c68c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.009314 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff791e-f434-469c-abb3-95a29f99c68c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.009583 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff791e-f434-469c-abb3-95a29f99c68c None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.010257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff791e-f434-469c-abb3-95a29f99c68c None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:22.010560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff791e-f434-469c-abb3-95a29f99c68c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:22.011972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff791e-f434-469c-abb3-95a29f99c68c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:22.025993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 244/496] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:22.026789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff791e-f434-469c-abb3-95a29f99c68c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.109682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7a074-10cc-454c-ac20-6a5d07810b36 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:22.115812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:22.143277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff791e-f434-469c-abb3-95a29f99c68c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:22.161019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd1be-f081-4d11-8b93-5cad6546efe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.162367 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd1be-f081-4d11-8b93-5cad6546efe6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.162875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd1be-f081-4d11-8b93-5cad6546efe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.163368 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd1be-f081-4d11-8b93-5cad6546efe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.164272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbd1be-f081-4d11-8b93-5cad6546efe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:22.165299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbd1be-f081-4d11-8b93-5cad6546efe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:22.167469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbd1be-f081-4d11-8b93-5cad6546efe6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:22.179563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb647c-3140-493e-b8d3-221802b6102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.180180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb647c-3140-493e-b8d3-221802b6102d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.180457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb647c-3140-493e-b8d3-221802b6102d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.180727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb647c-3140-493e-b8d3-221802b6102d None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.181373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb647c-3140-493e-b8d3-221802b6102d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:22.181673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb647c-3140-493e-b8d3-221802b6102d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:22.182354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 253/497] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:22.184515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd1be-f081-4d11-8b93-5cad6546efe6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.184624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb647c-3140-493e-b8d3-221802b6102d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:22.196242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 245/498] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:22.197582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e38448-e4c0-4937-9f60-384764873b25 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.197930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e38448-e4c0-4937-9f60-384764873b25 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.198826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e38448-e4c0-4937-9f60-384764873b25 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.199534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 246/499] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:22.200296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e38448-e4c0-4937-9f60-384764873b25 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.284025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:22.292994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd1be-f081-4d11-8b93-5cad6546efe6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:22.307550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e38448-e4c0-4937-9f60-384764873b25 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:22.327863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4b65e-14c5-4982-acd7-9a543adde931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.329029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4b65e-14c5-4982-acd7-9a543adde931 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.329308 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4b65e-14c5-4982-acd7-9a543adde931 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.329576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4b65e-14c5-4982-acd7-9a543adde931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.340328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4b65e-14c5-4982-acd7-9a543adde931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:22.341772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4b65e-14c5-4982-acd7-9a543adde931 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:22.343097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd99e8-333a-4792-915d-2d46dfd1b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.343923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd99e8-333a-4792-915d-2d46dfd1b745 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.344199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd99e8-333a-4792-915d-2d46dfd1b745 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.344470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd99e8-333a-4792-915d-2d46dfd1b745 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.347096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:22.352538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd99e8-333a-4792-915d-2d46dfd1b745 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:22.354159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd99e8-333a-4792-915d-2d46dfd1b745 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-52c4b65e-14c5-4982-acd7-9a543adde931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:22.356595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:22.357680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:22.358725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:22.358725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:22.358725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:22.358725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 254/500] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:22.359025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4b65e-14c5-4982-acd7-9a543adde931 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-bbbd99e8-333a-4792-915d-2d46dfd1b745 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:22.369722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:22.370688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:22.371702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 247/501] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:22.372281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748a5d-fcbd-4036-af75-426ffb8535ef None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.372464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748a5d-fcbd-4036-af75-426ffb8535ef None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.372734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748a5d-fcbd-4036-af75-426ffb8535ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.390763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e9748a5d-fcbd-4036-af75-426ffb8535ef None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:22.392001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e9748a5d-fcbd-4036-af75-426ffb8535ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:22.459068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 248/502] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:22.459953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748a5d-fcbd-4036-af75-426ffb8535ef None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.464392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4b65e-14c5-4982-acd7-9a543adde931 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:22.500320 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc896-1f2a-47ab-85b2-7ea7636ee8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.500959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc896-1f2a-47ab-85b2-7ea7636ee8db None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.501239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc896-1f2a-47ab-85b2-7ea7636ee8db None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.501502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc896-1f2a-47ab-85b2-7ea7636ee8db None admin] PATH_INFO: `/v3/users/glance` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.508988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedc896-1f2a-47ab-85b2-7ea7636ee8db None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:22.510427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedc896-1f2a-47ab-85b2-7ea7636ee8db None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ddedc896-1f2a-47ab-85b2-7ea7636ee8db None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:22.523622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:22.524605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:22.525546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 255/503] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:22.526123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc896-1f2a-47ab-85b2-7ea7636ee8db None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.530603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:22.577031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748a5d-fcbd-4036-af75-426ffb8535ef None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:22.603773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:22.614261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850d523-6c82-490e-918d-1cab5554ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.615015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850d523-6c82-490e-918d-1cab5554ff6c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.615423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850d523-6c82-490e-918d-1cab5554ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.615699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850d523-6c82-490e-918d-1cab5554ff6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.627366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850d523-6c82-490e-918d-1cab5554ff6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:22.631346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc896-1f2a-47ab-85b2-7ea7636ee8db None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4850d523-6c82-490e-918d-1cab5554ff6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:22.632097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:22.632938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 249/504] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:22.636109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850d523-6c82-490e-918d-1cab5554ff6c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.672750 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1de45-8a56-459b-8e80-c2e6c9c84528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.673417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1de45-8a56-459b-8e80-c2e6c9c84528 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.673702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1de45-8a56-459b-8e80-c2e6c9c84528 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.673981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1de45-8a56-459b-8e80-c2e6c9c84528 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.674617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1de45-8a56-459b-8e80-c2e6c9c84528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:22.674944 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1de45-8a56-459b-8e80-c2e6c9c84528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:22.676366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1de45-8a56-459b-8e80-c2e6c9c84528 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:22.690082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 256/505] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:22.690836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1de45-8a56-459b-8e80-c2e6c9c84528 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.742814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850d523-6c82-490e-918d-1cab5554ff6c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:22.773024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:22.776917 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8df02-2a77-47cf-9049-4665be262449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.777530 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8df02-2a77-47cf-9049-4665be262449 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.777849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8df02-2a77-47cf-9049-4665be262449 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.778141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8df02-2a77-47cf-9049-4665be262449 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.778872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8df02-2a77-47cf-9049-4665be262449 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:22.779164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8df02-2a77-47cf-9049-4665be262449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:22.780653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8df02-2a77-47cf-9049-4665be262449 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:22.810243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1de45-8a56-459b-8e80-c2e6c9c84528 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:22.817458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 250/506] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:22.818275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8df02-2a77-47cf-9049-4665be262449 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.849777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40384-9ce4-4731-844d-2fca34397917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.850383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40384-9ce4-4731-844d-2fca34397917 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.850653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40384-9ce4-4731-844d-2fca34397917 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.850913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40384-9ce4-4731-844d-2fca34397917 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.851671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40384-9ce4-4731-844d-2fca34397917 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:22.851969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40384-9ce4-4731-844d-2fca34397917 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:22.853393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40384-9ce4-4731-844d-2fca34397917 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:22.863288 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:22.892314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 257/507] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:22.893081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40384-9ce4-4731-844d-2fca34397917 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.917729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8df02-2a77-47cf-9049-4665be262449 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:22.955048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d97865-5238-4aa0-9f00-a8c6b5d14987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:22.955683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97865-5238-4aa0-9f00-a8c6b5d14987 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:22.955958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97865-5238-4aa0-9f00-a8c6b5d14987 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:22.956222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97865-5238-4aa0-9f00-a8c6b5d14987 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:22.956885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d97865-5238-4aa0-9f00-a8c6b5d14987 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:22.957183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d97865-5238-4aa0-9f00-a8c6b5d14987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:22.958575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d97865-5238-4aa0-9f00-a8c6b5d14987 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:22.972036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 251/508] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:22.972036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d97865-5238-4aa0-9f00-a8c6b5d14987 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:22.993869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40384-9ce4-4731-844d-2fca34397917 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.017359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:23.029820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd8e51-0fe3-4a91-abde-d1946134fac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.030472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd8e51-0fe3-4a91-abde-d1946134fac5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.030737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd8e51-0fe3-4a91-abde-d1946134fac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.031098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd8e51-0fe3-4a91-abde-d1946134fac5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:23.038280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd8e51-0fe3-4a91-abde-d1946134fac5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:23.039795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd8e51-0fe3-4a91-abde-d1946134fac5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-40cd8e51-0fe3-4a91-abde-d1946134fac5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:23.051785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:23.052744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 258/509] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:23.053628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd8e51-0fe3-4a91-abde-d1946134fac5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:23.075322 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d97865-5238-4aa0-9f00-a8c6b5d14987 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.082366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:23.111497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddc48c-b610-4947-b330-2f37702af6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.112130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddc48c-b610-4947-b330-2f37702af6bf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.112411 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddc48c-b610-4947-b330-2f37702af6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.112680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddc48c-b610-4947-b330-2f37702af6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:23.123456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddc48c-b610-4947-b330-2f37702af6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:23.125102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddc48c-b610-4947-b330-2f37702af6bf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-02ddc48c-b610-4947-b330-2f37702af6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:23.140966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:23.141978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:23.142883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:23.142883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:23.142883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:23.142883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 252/510] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:23.142883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddc48c-b610-4947-b330-2f37702af6bf None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:23.159595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd8e51-0fe3-4a91-abde-d1946134fac5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.193021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c52c7-8b7f-4165-8ef1-76b3bfae6982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.193625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c52c7-8b7f-4165-8ef1-76b3bfae6982 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.193894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c52c7-8b7f-4165-8ef1-76b3bfae6982 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.194156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c52c7-8b7f-4165-8ef1-76b3bfae6982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:23.242517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:23.244795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddc48c-b610-4947-b330-2f37702af6bf None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.261858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c52c7-8b7f-4165-8ef1-76b3bfae6982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:23.263643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c52c7-8b7f-4165-8ef1-76b3bfae6982 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:23.279407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c8cce-1fc6-4929-bb3c-bb9e0ec66c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.280015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c8cce-1fc6-4929-bb3c-bb9e0ec66c43 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.280291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c8cce-1fc6-4929-bb3c-bb9e0ec66c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.280561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c8cce-1fc6-4929-bb3c-bb9e0ec66c43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:23.307287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:23.351012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c8cce-1fc6-4929-bb3c-bb9e0ec66c43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:23.352500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c8cce-1fc6-4929-bb3c-bb9e0ec66c43 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:23.362722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 259/511] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:23.368195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c52c7-8b7f-4165-8ef1-76b3bfae6982 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:23.447710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:23.450217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 253/512] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:23.451191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c8cce-1fc6-4929-bb3c-bb9e0ec66c43 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:23.467193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c52c7-8b7f-4165-8ef1-76b3bfae6982 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.502009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dcc3d-5998-4c69-b474-b6041935db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.502641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dcc3d-5998-4c69-b474-b6041935db0a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.502918 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dcc3d-5998-4c69-b474-b6041935db0a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.503185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dcc3d-5998-4c69-b474-b6041935db0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:23.509873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:23.513318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dcc3d-5998-4c69-b474-b6041935db0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:23.514785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dcc3d-5998-4c69-b474-b6041935db0a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f98dcc3d-5998-4c69-b474-b6041935db0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:23.530499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:23.531621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:23.532624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:23.532624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:23.532624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:23.532624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 260/513] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:23.532624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dcc3d-5998-4c69-b474-b6041935db0a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:23.553409 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c8cce-1fc6-4929-bb3c-bb9e0ec66c43 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.586903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c77b65-125b-47d6-a345-d2ff703a144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.587610 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77b65-125b-47d6-a345-d2ff703a144e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.587890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77b65-125b-47d6-a345-d2ff703a144e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.588156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77b65-125b-47d6-a345-d2ff703a144e None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:23.588893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c77b65-125b-47d6-a345-d2ff703a144e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:23.589189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c77b65-125b-47d6-a345-d2ff703a144e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:23.590611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c77b65-125b-47d6-a345-d2ff703a144e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:23.607185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 254/514] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Oct 6 04:19:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:23.608100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c77b65-125b-47d6-a345-d2ff703a144e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:23.633098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dcc3d-5998-4c69-b474-b6041935db0a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.666560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e24be5-3b47-45d8-b2d3-258cf012b12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.667163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24be5-3b47-45d8-b2d3-258cf012b12e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.667473 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24be5-3b47-45d8-b2d3-258cf012b12e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.667734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24be5-3b47-45d8-b2d3-258cf012b12e None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:23.668357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e24be5-3b47-45d8-b2d3-258cf012b12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:23.668653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e24be5-3b47-45d8-b2d3-258cf012b12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:23.670012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e24be5-3b47-45d8-b2d3-258cf012b12e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:23.671414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:23.683090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 261/515] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:23.683981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e24be5-3b47-45d8-b2d3-258cf012b12e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:23.710719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c77b65-125b-47d6-a345-d2ff703a144e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.727452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:23.745640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad1adc-1646-462b-8630-4a6745327bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.746274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1adc-1646-462b-8630-4a6745327bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.746553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1adc-1646-462b-8630-4a6745327bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.746823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1adc-1646-462b-8630-4a6745327bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:23.757577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad1adc-1646-462b-8630-4a6745327bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:23.759048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad1adc-1646-462b-8630-4a6745327bd4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b6ad1adc-1646-462b-8630-4a6745327bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:23.773270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:23.774340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:23.775389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:23.775389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:23.775389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:23.775389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 255/516] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:23.775633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad1adc-1646-462b-8630-4a6745327bd4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:23.788234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e24be5-3b47-45d8-b2d3-258cf012b12e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.822876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fcad3-ee4c-4c8f-8ce4-dde2116563af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.823532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fcad3-ee4c-4c8f-8ce4-dde2116563af None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.823808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fcad3-ee4c-4c8f-8ce4-dde2116563af None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.824076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fcad3-ee4c-4c8f-8ce4-dde2116563af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:23.834218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fcad3-ee4c-4c8f-8ce4-dde2116563af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:23.835698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fcad3-ee4c-4c8f-8ce4-dde2116563af None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-184fcad3-ee4c-4c8f-8ce4-dde2116563af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:23.850037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:23.851115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:23.852105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:23.852105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:23.852105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:23.852105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 262/517] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:23.852105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fcad3-ee4c-4c8f-8ce4-dde2116563af None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:23.880088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad1adc-1646-462b-8630-4a6745327bd4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.901688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:23.912921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05cc5b-0d32-4b76-a7d3-d28258759c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.913600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05cc5b-0d32-4b76-a7d3-d28258759c3a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.913876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05cc5b-0d32-4b76-a7d3-d28258759c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.914142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05cc5b-0d32-4b76-a7d3-d28258759c3a None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:23.914783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05cc5b-0d32-4b76-a7d3-d28258759c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:23.915078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05cc5b-0d32-4b76-a7d3-d28258759c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:23.916502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05cc5b-0d32-4b76-a7d3-d28258759c3a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:23.928114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 256/518] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:23.928974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05cc5b-0d32-4b76-a7d3-d28258759c3a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:23.957108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:23.961853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fcad3-ee4c-4c8f-8ce4-dde2116563af None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:23.996781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6883396-f98a-4353-afbc-35a65e1fb48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:23.997396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6883396-f98a-4353-afbc-35a65e1fb48d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:23.997671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6883396-f98a-4353-afbc-35a65e1fb48d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:23.997938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6883396-f98a-4353-afbc-35a65e1fb48d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.029091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05cc5b-0d32-4b76-a7d3-d28258759c3a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:24.063080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccde75e-9140-463c-8eb9-1ad090219e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:24.063703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccde75e-9140-463c-8eb9-1ad090219e78 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:24.063978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccde75e-9140-463c-8eb9-1ad090219e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:24.064242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccde75e-9140-463c-8eb9-1ad090219e78 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.064897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccde75e-9140-463c-8eb9-1ad090219e78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.066312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccde75e-9140-463c-8eb9-1ad090219e78 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.068219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6883396-f98a-4353-afbc-35a65e1fb48d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.069680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6883396-f98a-4353-afbc-35a65e1fb48d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.087035 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 257/519] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:19:23 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:19:24.087954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccde75e-9140-463c-8eb9-1ad090219e78 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:24.121069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:24.182354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 263/520] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:24.183343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6883396-f98a-4353-afbc-35a65e1fb48d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:24.184360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:24.204597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccde75e-9140-463c-8eb9-1ad090219e78 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:24.244167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561da6a9-ec44-407d-81a0-35c06256d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:24.244905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561da6a9-ec44-407d-81a0-35c06256d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:24.245286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561da6a9-ec44-407d-81a0-35c06256d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:24.245655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561da6a9-ec44-407d-81a0-35c06256d9e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.246389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561da6a9-ec44-407d-81a0-35c06256d9e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:24.246756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561da6a9-ec44-407d-81a0-35c06256d9e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.248294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561da6a9-ec44-407d-81a0-35c06256d9e8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.262413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 258/521] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:24.263441 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561da6a9-ec44-407d-81a0-35c06256d9e8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:24.301554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6883396-f98a-4353-afbc-35a65e1fb48d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:24.342533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856a3b-e918-4277-aafd-ac618d57c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:24.343372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856a3b-e918-4277-aafd-ac618d57c9da None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:24.343652 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856a3b-e918-4277-aafd-ac618d57c9da None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:24.343924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856a3b-e918-4277-aafd-ac618d57c9da None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.344556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29856a3b-e918-4277-aafd-ac618d57c9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:24.344850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29856a3b-e918-4277-aafd-ac618d57c9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.346220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29856a3b-e918-4277-aafd-ac618d57c9da None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.357838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 264/522] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:24.358740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856a3b-e918-4277-aafd-ac618d57c9da None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:24.369081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:24.383575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561da6a9-ec44-407d-81a0-35c06256d9e8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:24.419072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bac854-761e-495a-8c19-44e703dbd358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:24.419796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bac854-761e-495a-8c19-44e703dbd358 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:24.420073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bac854-761e-495a-8c19-44e703dbd358 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:24.420345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bac854-761e-495a-8c19-44e703dbd358 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.428068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bac854-761e-495a-8c19-44e703dbd358 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.429545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bac854-761e-495a-8c19-44e703dbd358 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d8bac854-761e-495a-8c19-44e703dbd358 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:24.441801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:24.442758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 259/523] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:24.444105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bac854-761e-495a-8c19-44e703dbd358 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:24.449701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:24.472958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856a3b-e918-4277-aafd-ac618d57c9da None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:24.511935 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d812e-416a-490c-bd4e-82f0ee497cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:24.512715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d812e-416a-490c-bd4e-82f0ee497cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:24.513084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d812e-416a-490c-bd4e-82f0ee497cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:24.513447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d812e-416a-490c-bd4e-82f0ee497cc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.527085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d812e-416a-490c-bd4e-82f0ee497cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.528836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d812e-416a-490c-bd4e-82f0ee497cc5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-115d812e-416a-490c-bd4e-82f0ee497cc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:24.545691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:24.552041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:24.553090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:24.553090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:24.553090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:24.553090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 265/524] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:24.553090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d812e-416a-490c-bd4e-82f0ee497cc5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:24.555497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bac854-761e-495a-8c19-44e703dbd358 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:24.593806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309864e-3127-451d-acb8-2aa16fadd10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:24.594987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309864e-3127-451d-acb8-2aa16fadd10b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:24.595258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309864e-3127-451d-acb8-2aa16fadd10b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:24.595571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309864e-3127-451d-acb8-2aa16fadd10b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.602734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309864e-3127-451d-acb8-2aa16fadd10b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.604234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309864e-3127-451d-acb8-2aa16fadd10b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.611616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a309864e-3127-451d-acb8-2aa16fadd10b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:24.616715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:24.618037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:24.619076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:24.619076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:24.619076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:24.619076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:24.619076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:24.619076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:24.619076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:24.619076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:24.623948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 260/525] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:24.623948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309864e-3127-451d-acb8-2aa16fadd10b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:24.659952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d812e-416a-490c-bd4e-82f0ee497cc5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:24.685490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:24.697981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96018452-2483-4b95-9b6c-9167c46814b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:24.698616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96018452-2483-4b95-9b6c-9167c46814b2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:24.698888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96018452-2483-4b95-9b6c-9167c46814b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:24.699137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96018452-2483-4b95-9b6c-9167c46814b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.706819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96018452-2483-4b95-9b6c-9167c46814b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.708384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96018452-2483-4b95-9b6c-9167c46814b2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-96018452-2483-4b95-9b6c-9167c46814b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:24.722886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:24.724033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:24.729895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:24.729895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:24.729895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:24.729895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:24.729895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:24.729895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:24.729895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:24.729895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:24.729895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 266/526] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:24.729895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96018452-2483-4b95-9b6c-9167c46814b2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:24.733741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309864e-3127-451d-acb8-2aa16fadd10b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:24.769987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ab246-31aa-4b94-bb15-9eab9cc8336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:24.770610 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ab246-31aa-4b94-bb15-9eab9cc8336e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:24.770940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ab246-31aa-4b94-bb15-9eab9cc8336e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:24.771282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ab246-31aa-4b94-bb15-9eab9cc8336e None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.772156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ab246-31aa-4b94-bb15-9eab9cc8336e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:24.772526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ab246-31aa-4b94-bb15-9eab9cc8336e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.774053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ab246-31aa-4b94-bb15-9eab9cc8336e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.792469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 261/527] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:24.793443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ab246-31aa-4b94-bb15-9eab9cc8336e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:24.842980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96018452-2483-4b95-9b6c-9167c46814b2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:24.860724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:24.878450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797255-5e62-4d78-86ee-fe8c6730ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:24.879064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797255-5e62-4d78-86ee-fe8c6730ea88 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:24.879363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797255-5e62-4d78-86ee-fe8c6730ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:24.879631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797255-5e62-4d78-86ee-fe8c6730ea88 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.880279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797255-5e62-4d78-86ee-fe8c6730ea88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:24.880580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797255-5e62-4d78-86ee-fe8c6730ea88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.881959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797255-5e62-4d78-86ee-fe8c6730ea88 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.895122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 267/528] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:24.896142 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797255-5e62-4d78-86ee-fe8c6730ea88 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:24.907700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ab246-31aa-4b94-bb15-9eab9cc8336e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:24.931812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:24.948244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e3328-a58d-4a31-9295-d557e48031f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:24.948941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e3328-a58d-4a31-9295-d557e48031f0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:24.949279 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e3328-a58d-4a31-9295-d557e48031f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:24.949609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e3328-a58d-4a31-9295-d557e48031f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:24.950395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e3328-a58d-4a31-9295-d557e48031f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:24.950762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e3328-a58d-4a31-9295-d557e48031f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:24.952282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e3328-a58d-4a31-9295-d557e48031f0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:24.975137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 262/529] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:24.975137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e3328-a58d-4a31-9295-d557e48031f0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:25.012295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797255-5e62-4d78-86ee-fe8c6730ea88 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:25.051499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9bd1-dfc1-4c29-8fef-89fbf3e837a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:25.052034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9bd1-dfc1-4c29-8fef-89fbf3e837a9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:25.052312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9bd1-dfc1-4c29-8fef-89fbf3e837a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:25.052579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9bd1-dfc1-4c29-8fef-89fbf3e837a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:25.053268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9bd1-dfc1-4c29-8fef-89fbf3e837a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:25.053578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9bd1-dfc1-4c29-8fef-89fbf3e837a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:25.055023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9bd1-dfc1-4c29-8fef-89fbf3e837a9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:25.072702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 268/530] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:25.073700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9bd1-dfc1-4c29-8fef-89fbf3e837a9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:25.086528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e3328-a58d-4a31-9295-d557e48031f0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:25.116823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:25.121767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe63e8-5a46-4ad5-b421-e919d3240cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:25.122377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe63e8-5a46-4ad5-b421-e919d3240cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:25.122648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe63e8-5a46-4ad5-b421-e919d3240cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:25.122912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe63e8-5a46-4ad5-b421-e919d3240cb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:25.173254 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:25.184696 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9bd1-dfc1-4c29-8fef-89fbf3e837a9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:25.192831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe63e8-5a46-4ad5-b421-e919d3240cb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:25.194436 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe63e8-5a46-4ad5-b421-e919d3240cb8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:25.224768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e61bb-a211-4dbc-b420-2008c1f2d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:25.225815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e61bb-a211-4dbc-b420-2008c1f2d9bb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:25.226189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e61bb-a211-4dbc-b420-2008c1f2d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:25.226582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e61bb-a211-4dbc-b420-2008c1f2d9bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:25.234862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e61bb-a211-4dbc-b420-2008c1f2d9bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:25.237388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e61bb-a211-4dbc-b420-2008c1f2d9bb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c38e61bb-a211-4dbc-b420-2008c1f2d9bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:25.252306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:25.253337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:25.254265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:25.254265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:25.254265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:25.254265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:25.254265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:25.254265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:25.254265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:25.254265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:25.254265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 269/531] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:25.255007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e61bb-a211-4dbc-b420-2008c1f2d9bb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:25.309665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 263/532] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:25.309665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe63e8-5a46-4ad5-b421-e919d3240cb8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:25.370872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:25.374949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e61bb-a211-4dbc-b420-2008c1f2d9bb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:25.402798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:25.412686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9cce8-fd25-4241-8ccd-e5fee6a93b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:25.413422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9cce8-fd25-4241-8ccd-e5fee6a93b64 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:25.413694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9cce8-fd25-4241-8ccd-e5fee6a93b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:25.414104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9cce8-fd25-4241-8ccd-e5fee6a93b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:25.414687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9cce8-fd25-4241-8ccd-e5fee6a93b64 None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=0481d4c0be0b46189e339d1e00bee4c0) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:25.415016 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9cce8-fd25-4241-8ccd-e5fee6a93b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:25.416457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9cce8-fd25-4241-8ccd-e5fee6a93b64 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:25.431330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 270/533] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:25 2022] GET /identity/v3/role_assignments?user.id=0481d4c0be0b46189e339d1e00bee4c0&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:25.431330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9cce8-fd25-4241-8ccd-e5fee6a93b64 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:25.431624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe63e8-5a46-4ad5-b421-e919d3240cb8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:25.468007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8f83e-2d21-41c7-b761-a3b81a49df5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:25.468862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8f83e-2d21-41c7-b761-a3b81a49df5a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:25.469433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8f83e-2d21-41c7-b761-a3b81a49df5a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:25.469881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8f83e-2d21-41c7-b761-a3b81a49df5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:25.471004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8f83e-2d21-41c7-b761-a3b81a49df5a None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=457880195ed849d2b594ddea6acdf7df) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:25.471337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8f83e-2d21-41c7-b761-a3b81a49df5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:25.473044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8f83e-2d21-41c7-b761-a3b81a49df5a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:25.480842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 264/534] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:25 2022] GET /identity/v3/role_assignments?user.id=457880195ed849d2b594ddea6acdf7df&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:25.481846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8f83e-2d21-41c7-b761-a3b81a49df5a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:25.586919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9cce8-fd25-4241-8ccd-e5fee6a93b64 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:25.668333 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a212fa3-74b4-4f96-a0d6-090afbfad826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:25.668992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a212fa3-74b4-4f96-a0d6-090afbfad826 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:25.669276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a212fa3-74b4-4f96-a0d6-090afbfad826 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:25.669541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a212fa3-74b4-4f96-a0d6-090afbfad826 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:25.670251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a212fa3-74b4-4f96-a0d6-090afbfad826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:25.670549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a212fa3-74b4-4f96-a0d6-090afbfad826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:25.673580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a212fa3-74b4-4f96-a0d6-090afbfad826 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:25.685367 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8f83e-2d21-41c7-b761-a3b81a49df5a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:25.690281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 271/535] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:25.695459 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a212fa3-74b4-4f96-a0d6-090afbfad826 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:25.738253 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:25.756618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b97b0-1f35-4f1f-88e2-85556f05dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:25.757264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b97b0-1f35-4f1f-88e2-85556f05dced None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:25.757683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b97b0-1f35-4f1f-88e2-85556f05dced None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:25.757952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b97b0-1f35-4f1f-88e2-85556f05dced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:25.781151 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b97b0-1f35-4f1f-88e2-85556f05dced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:25.782586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b97b0-1f35-4f1f-88e2-85556f05dced None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:25.798981 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-425b97b0-1f35-4f1f-88e2-85556f05dced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:25.818389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:25.819405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:25.820257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:25.820257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:25.820257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:25.823343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 265/536] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:25.830649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b97b0-1f35-4f1f-88e2-85556f05dced None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:25.880680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a212fa3-74b4-4f96-a0d6-090afbfad826 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:25.930090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb7cc9-876c-4c1f-bc8b-af3a80db1c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:25.930714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb7cc9-876c-4c1f-bc8b-af3a80db1c0d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:25.931043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb7cc9-876c-4c1f-bc8b-af3a80db1c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:25.931344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb7cc9-876c-4c1f-bc8b-af3a80db1c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:25.932076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb7cc9-876c-4c1f-bc8b-af3a80db1c0d None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=e66a78c94f03443cbae595bba07e458d) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:25.932380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb7cc9-876c-4c1f-bc8b-af3a80db1c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:25.933841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb7cc9-876c-4c1f-bc8b-af3a80db1c0d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:25.941245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 272/537] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:25 2022] GET /identity/v3/role_assignments?user.id=e66a78c94f03443cbae595bba07e458d&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:26.021485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b97b0-1f35-4f1f-88e2-85556f05dced None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:26.064912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f85ca8-53ca-4ffc-90dc-d12dd31536ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:26.065542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f85ca8-53ca-4ffc-90dc-d12dd31536ec None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:26.065814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f85ca8-53ca-4ffc-90dc-d12dd31536ec None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:26.066087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f85ca8-53ca-4ffc-90dc-d12dd31536ec None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:26.066749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f85ca8-53ca-4ffc-90dc-d12dd31536ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:26.067046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f85ca8-53ca-4ffc-90dc-d12dd31536ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:26.068501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f85ca8-53ca-4ffc-90dc-d12dd31536ec None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:26.086890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 266/538] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:26.092161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb7cc9-876c-4c1f-bc8b-af3a80db1c0d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:26.224662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:26.241899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb7cc9-876c-4c1f-bc8b-af3a80db1c0d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:26.288375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811e06d-6b67-474e-9757-8515556f6ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:26.289065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811e06d-6b67-474e-9757-8515556f6ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:26.289337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811e06d-6b67-474e-9757-8515556f6ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:26.289602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811e06d-6b67-474e-9757-8515556f6ba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:26.310549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811e06d-6b67-474e-9757-8515556f6ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:26.310549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811e06d-6b67-474e-9757-8515556f6ba5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4811e06d-6b67-474e-9757-8515556f6ba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:26.332680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:26.333578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:26.334426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:26.334426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:26.334426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:26.334426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:26.334426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:26.334426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:26.334426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:26.334426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:26.334426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 273/539] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:26.339577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f85ca8-53ca-4ffc-90dc-d12dd31536ec None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:26.415430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:26.424261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147ad3b-c41b-498e-b3c6-091de82836aa None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:26.424557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147ad3b-c41b-498e-b3c6-091de82836aa None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:26.424806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147ad3b-c41b-498e-b3c6-091de82836aa None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:26.426395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 274/540] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:19:26.435102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52530e-2f5f-4edd-ad92-b271a9275591 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:26.435404 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52530e-2f5f-4edd-ad92-b271a9275591 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:26.435677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52530e-2f5f-4edd-ad92-b271a9275591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:26.468458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fa52530e-2f5f-4edd-ad92-b271a9275591 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:26.469710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fa52530e-2f5f-4edd-ad92-b271a9275591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:26.488657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f85ca8-53ca-4ffc-90dc-d12dd31536ec None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:26.550448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 275/541] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:26.569435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342da1c-dffe-4773-aad1-2d2305e27b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:26.570115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342da1c-dffe-4773-aad1-2d2305e27b7b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:26.570395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342da1c-dffe-4773-aad1-2d2305e27b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:26.570663 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342da1c-dffe-4773-aad1-2d2305e27b7b None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:26.571384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342da1c-dffe-4773-aad1-2d2305e27b7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:26.571735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342da1c-dffe-4773-aad1-2d2305e27b7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:26.573423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342da1c-dffe-4773-aad1-2d2305e27b7b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:26.592113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 267/542] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:26.598239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52530e-2f5f-4edd-ad92-b271a9275591 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:26.687731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:26.709912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52530e-2f5f-4edd-ad92-b271a9275591 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:26.746021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa61e2-6fe1-4211-b1d6-75f894614204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:26.746559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa61e2-6fe1-4211-b1d6-75f894614204 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:26.746831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa61e2-6fe1-4211-b1d6-75f894614204 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:26.747157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa61e2-6fe1-4211-b1d6-75f894614204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:26.747926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa61e2-6fe1-4211-b1d6-75f894614204 None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=39ca0a824c4740dbb911bb1a38cfc47b) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:26.748230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa61e2-6fe1-4211-b1d6-75f894614204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:26.749760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa61e2-6fe1-4211-b1d6-75f894614204 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:26.759793 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 276/543] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:26 2022] GET /identity/v3/role_assignments?user.id=39ca0a824c4740dbb911bb1a38cfc47b&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:26.912854 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342da1c-dffe-4773-aad1-2d2305e27b7b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:27.052560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342da1c-dffe-4773-aad1-2d2305e27b7b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:27.074205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:27.093751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fbf19-3048-455f-bb74-cb506966b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:27.094394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fbf19-3048-455f-bb74-cb506966b18d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:27.094674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fbf19-3048-455f-bb74-cb506966b18d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:27.094943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fbf19-3048-455f-bb74-cb506966b18d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:27.105268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fbf19-3048-455f-bb74-cb506966b18d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ec4fbf19-3048-455f-bb74-cb506966b18d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:27.110222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:27.111111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:27.112109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 268/544] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:27.121040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa61e2-6fe1-4211-b1d6-75f894614204 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:27.259988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa61e2-6fe1-4211-b1d6-75f894614204 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:27.299907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43973826-dd59-409d-b28e-7c7a1b3b58aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:27.300524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973826-dd59-409d-b28e-7c7a1b3b58aa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:27.300795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973826-dd59-409d-b28e-7c7a1b3b58aa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:27.301059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973826-dd59-409d-b28e-7c7a1b3b58aa None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:27.301724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43973826-dd59-409d-b28e-7c7a1b3b58aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:27.302023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43973826-dd59-409d-b28e-7c7a1b3b58aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:27.303470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43973826-dd59-409d-b28e-7c7a1b3b58aa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:27.315195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 277/545] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:27.321015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fbf19-3048-455f-bb74-cb506966b18d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:27.455631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fbf19-3048-455f-bb74-cb506966b18d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:27.497847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2b78e-2f19-4869-90ee-403aef394556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:27.498875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b78e-2f19-4869-90ee-403aef394556 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:27.499379 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b78e-2f19-4869-90ee-403aef394556 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:27.499926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b78e-2f19-4869-90ee-403aef394556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:27.510635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2b78e-2f19-4869-90ee-403aef394556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:27.512447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2b78e-2f19-4869-90ee-403aef394556 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-90a2b78e-2f19-4869-90ee-403aef394556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:27.527397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:27.528355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:27.529224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:27.529224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:27.529224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:27.531353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 269/546] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:27.540650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43973826-dd59-409d-b28e-7c7a1b3b58aa None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:27.547659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:27.687381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43973826-dd59-409d-b28e-7c7a1b3b58aa None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:27.732112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd314ac-4e2e-4f33-8871-69ef6087d6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:27.732755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd314ac-4e2e-4f33-8871-69ef6087d6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:27.733011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd314ac-4e2e-4f33-8871-69ef6087d6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:27.733280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd314ac-4e2e-4f33-8871-69ef6087d6f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:27.734032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd314ac-4e2e-4f33-8871-69ef6087d6f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:27.734333 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd314ac-4e2e-4f33-8871-69ef6087d6f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:27.735942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd314ac-4e2e-4f33-8871-69ef6087d6f0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:27.749977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 278/547] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:27.760135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2b78e-2f19-4869-90ee-403aef394556 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:27.803345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:27.874315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2b78e-2f19-4869-90ee-403aef394556 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:27.909585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f26d3-1ebe-44ac-b97a-b83d28a4cfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:27.910618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f26d3-1ebe-44ac-b97a-b83d28a4cfe1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:27.911095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f26d3-1ebe-44ac-b97a-b83d28a4cfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:27.911592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f26d3-1ebe-44ac-b97a-b83d28a4cfe1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:27.925764 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f26d3-1ebe-44ac-b97a-b83d28a4cfe1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:27.928057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f26d3-1ebe-44ac-b97a-b83d28a4cfe1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d59f26d3-1ebe-44ac-b97a-b83d28a4cfe1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:27.944416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:27.945890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:27.946978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:27.946978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:27.946978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:27.946978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:27.946978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:27.946978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:27.946978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:27.946978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:27.946978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:27.946978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:27.950523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 270/548] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:27.956443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd314ac-4e2e-4f33-8871-69ef6087d6f0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:28.037924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:28.081336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd314ac-4e2e-4f33-8871-69ef6087d6f0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:28.122777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401198b0-a35f-455b-9315-74787ad30b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:28.123422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401198b0-a35f-455b-9315-74787ad30b53 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:28.123699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401198b0-a35f-455b-9315-74787ad30b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:28.123969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401198b0-a35f-455b-9315-74787ad30b53 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:28.124795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401198b0-a35f-455b-9315-74787ad30b53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:28.125101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401198b0-a35f-455b-9315-74787ad30b53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:28.126565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401198b0-a35f-455b-9315-74787ad30b53 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:28.145061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 279/549] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 6 04:19:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:28.150677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f26d3-1ebe-44ac-b97a-b83d28a4cfe1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:28.176221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422292-4168-4893-b696-c0ce25928bb6 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:28.176540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422292-4168-4893-b696-c0ce25928bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:28.176751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422292-4168-4893-b696-c0ce25928bb6 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:28.178464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 280/550] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:19:28.184341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588710-a97d-42e7-a2f7-db0b560ba5f3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:28.184674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588710-a97d-42e7-a2f7-db0b560ba5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:28.184887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588710-a97d-42e7-a2f7-db0b560ba5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:28.205973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e8588710-a97d-42e7-a2f7-db0b560ba5f3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:28.207086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e8588710-a97d-42e7-a2f7-db0b560ba5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:28.294829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 281/551] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:19:28.330990 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7af87-a6f9-4907-86a0-4f8e78146b7c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:28.331276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7af87-a6f9-4907-86a0-4f8e78146b7c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:28.331578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7af87-a6f9-4907-86a0-4f8e78146b7c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:28.333171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 282/552] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:19:28.338045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbefd1-b86c-462f-976e-ceeffc559866 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:28.338326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbefd1-b86c-462f-976e-ceeffc559866 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:28.338596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbefd1-b86c-462f-976e-ceeffc559866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:28.354242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:28.357185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-62cbefd1-b86c-462f-976e-ceeffc559866 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:28.358392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-62cbefd1-b86c-462f-976e-ceeffc559866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:28.372275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f26d3-1ebe-44ac-b97a-b83d28a4cfe1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:28.407878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:28.409041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164077f-d26f-4edf-bdea-876fab215faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:28.409874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164077f-d26f-4edf-bdea-876fab215faf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:28.410416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164077f-d26f-4edf-bdea-876fab215faf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:28.410915 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164077f-d26f-4edf-bdea-876fab215faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:28.430964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 283/553] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:19:28.489741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164077f-d26f-4edf-bdea-876fab215faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:28.495842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164077f-d26f-4edf-bdea-876fab215faf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:28.598954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:28.613497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 271/554] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:28.619213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbefd1-b86c-462f-976e-ceeffc559866 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:28.680595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164077f-d26f-4edf-bdea-876fab215faf None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:28.784796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbefd1-b86c-462f-976e-ceeffc559866 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:28.820408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e3081-554d-4a93-8021-c2136e0aba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:28.821055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3081-554d-4a93-8021-c2136e0aba16 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:28.821333 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3081-554d-4a93-8021-c2136e0aba16 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:28.821600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3081-554d-4a93-8021-c2136e0aba16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:28.821958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164077f-d26f-4edf-bdea-876fab215faf None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:28.832321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e3081-554d-4a93-8021-c2136e0aba16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:28.833771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e3081-554d-4a93-8021-c2136e0aba16 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9a8e3081-554d-4a93-8021-c2136e0aba16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:28.848723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:28.849695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:28.850573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:28.850573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:28.850573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:28.850573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 284/555] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:28.850802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e3081-554d-4a93-8021-c2136e0aba16 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:28.863126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57467dfb-ea77-4a25-a9d5-8cbb5d595e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:28.863792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57467dfb-ea77-4a25-a9d5-8cbb5d595e3c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:28.864067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57467dfb-ea77-4a25-a9d5-8cbb5d595e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:28.864332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57467dfb-ea77-4a25-a9d5-8cbb5d595e3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:28.874761 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57467dfb-ea77-4a25-a9d5-8cbb5d595e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-57467dfb-ea77-4a25-a9d5-8cbb5d595e3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:28.879699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:28.880709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:28.881528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 272/556] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:28.882232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487949f3-803c-413f-be73-6ee2b86db03a None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:28.882232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487949f3-803c-413f-be73-6ee2b86db03a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:28.882703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487949f3-803c-413f-be73-6ee2b86db03a None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:28.887431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 273/557] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:28.888548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487949f3-803c-413f-be73-6ee2b86db03a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:28.890731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:28.946463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:28.964015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e3081-554d-4a93-8021-c2136e0aba16 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:28.993162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487949f3-803c-413f-be73-6ee2b86db03a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.000320 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda7b6-d000-4832-aae5-8e58687b1c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.000972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda7b6-d000-4832-aae5-8e58687b1c3a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.001252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda7b6-d000-4832-aae5-8e58687b1c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.001525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda7b6-d000-4832-aae5-8e58687b1c3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.014016 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfda7b6-d000-4832-aae5-8e58687b1c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-edfda7b6-d000-4832-aae5-8e58687b1c3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:29.021165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:29.022632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 285/558] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:29.023902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda7b6-d000-4832-aae5-8e58687b1c3a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.034125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796d990-dcdc-4bcc-9856-6c6ec997f676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.034729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796d990-dcdc-4bcc-9856-6c6ec997f676 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.035053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796d990-dcdc-4bcc-9856-6c6ec997f676 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.035268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796d990-dcdc-4bcc-9856-6c6ec997f676 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.035972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796d990-dcdc-4bcc-9856-6c6ec997f676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:29.036266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796d990-dcdc-4bcc-9856-6c6ec997f676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:29.037637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796d990-dcdc-4bcc-9856-6c6ec997f676 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:29.049051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 274/559] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:29.054539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db87aff-ba94-49fc-bb78-338f52b353bf None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.054819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db87aff-ba94-49fc-bb78-338f52b353bf None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.055089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db87aff-ba94-49fc-bb78-338f52b353bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.073085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9db87aff-ba94-49fc-bb78-338f52b353bf None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:29.074267 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9db87aff-ba94-49fc-bb78-338f52b353bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:29.120659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:29.131218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda7b6-d000-4832-aae5-8e58687b1c3a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.141529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 275/560] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:29.142321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db87aff-ba94-49fc-bb78-338f52b353bf None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.177474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac65bb-3bbb-4934-b110-bca6115c5028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.178087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac65bb-3bbb-4934-b110-bca6115c5028 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.178359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac65bb-3bbb-4934-b110-bca6115c5028 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.178623 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac65bb-3bbb-4934-b110-bca6115c5028 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.179286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac65bb-3bbb-4934-b110-bca6115c5028 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:29.179635 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac65bb-3bbb-4934-b110-bca6115c5028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:29.181114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac65bb-3bbb-4934-b110-bca6115c5028 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:29.190302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 286/561] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:29.191037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac65bb-3bbb-4934-b110-bca6115c5028 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.199335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:29.271977 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db87aff-ba94-49fc-bb78-338f52b353bf None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.316492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3075f80-528f-4670-a415-96310367fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.317064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3075f80-528f-4670-a415-96310367fd75 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.317307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3075f80-528f-4670-a415-96310367fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.319274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac65bb-3bbb-4934-b110-bca6115c5028 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.320992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3075f80-528f-4670-a415-96310367fd75 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.322556 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3075f80-528f-4670-a415-96310367fd75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:29.322737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3075f80-528f-4670-a415-96310367fd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:29.324148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3075f80-528f-4670-a415-96310367fd75 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:29.333078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 276/562] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:29.334001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3075f80-528f-4670-a415-96310367fd75 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.358586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089614fe-8b27-4889-929d-0c51b07cddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.359846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089614fe-8b27-4889-929d-0c51b07cddb8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.360379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089614fe-8b27-4889-929d-0c51b07cddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.360849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089614fe-8b27-4889-929d-0c51b07cddb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.369118 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089614fe-8b27-4889-929d-0c51b07cddb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:29.370955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089614fe-8b27-4889-929d-0c51b07cddb8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-089614fe-8b27-4889-929d-0c51b07cddb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:29.383410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:29.384335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:29.385241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:29.385241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:29.385241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:29.385241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:29.385241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:29.385241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:29.385241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:29.385241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:29.385241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 287/563] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:29.385791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089614fe-8b27-4889-929d-0c51b07cddb8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.401895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:29.445853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3075f80-528f-4670-a415-96310367fd75 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.447392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:29.479984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487db12-5da7-4f6a-84d1-4d810e234e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.480611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487db12-5da7-4f6a-84d1-4d810e234e9b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.480882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487db12-5da7-4f6a-84d1-4d810e234e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.481143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487db12-5da7-4f6a-84d1-4d810e234e9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.486545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089614fe-8b27-4889-929d-0c51b07cddb8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.491089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487db12-5da7-4f6a-84d1-4d810e234e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:29.493007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487db12-5da7-4f6a-84d1-4d810e234e9b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4487db12-5da7-4f6a-84d1-4d810e234e9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:29.508584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:29.509569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:29.510447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:29.510447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:29.510447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:29.510447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 277/564] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:29.510810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfa33-3817-4b62-8f38-047212209c00 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.511068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfa33-3817-4b62-8f38-047212209c00 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.511351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfa33-3817-4b62-8f38-047212209c00 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.512552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 278/565] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:29.516146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfa33-3817-4b62-8f38-047212209c00 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.525703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c55e9e-ca04-4e11-baa8-b32c38d3ec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.526346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c55e9e-ca04-4e11-baa8-b32c38d3ec1c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.526618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c55e9e-ca04-4e11-baa8-b32c38d3ec1c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.526863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c55e9e-ca04-4e11-baa8-b32c38d3ec1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.537860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c55e9e-ca04-4e11-baa8-b32c38d3ec1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:29.539416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c55e9e-ca04-4e11-baa8-b32c38d3ec1c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c8c55e9e-ca04-4e11-baa8-b32c38d3ec1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:29.553837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:29.554767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:29.555745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:29.555745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:29.555745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:29.555745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 288/566] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:29.555745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c55e9e-ca04-4e11-baa8-b32c38d3ec1c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.619571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfa33-3817-4b62-8f38-047212209c00 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.625116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:29.653619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c69e41-00fe-460b-8050-331cc3bb2f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.654226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c69e41-00fe-460b-8050-331cc3bb2f52 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.654506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c69e41-00fe-460b-8050-331cc3bb2f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.654768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c69e41-00fe-460b-8050-331cc3bb2f52 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.655492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c69e41-00fe-460b-8050-331cc3bb2f52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:29.655877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c69e41-00fe-460b-8050-331cc3bb2f52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:29.657321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c69e41-00fe-460b-8050-331cc3bb2f52 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:29.658473 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c55e9e-ca04-4e11-baa8-b32c38d3ec1c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.668910 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 279/567] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:29.669773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c69e41-00fe-460b-8050-331cc3bb2f52 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.684628 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:29.693201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e3340-3eb9-49a1-b632-2b1ac6010a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.693836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3340-3eb9-49a1-b632-2b1ac6010a96 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.694113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3340-3eb9-49a1-b632-2b1ac6010a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.694379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3340-3eb9-49a1-b632-2b1ac6010a96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.704249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e3340-3eb9-49a1-b632-2b1ac6010a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e06e3340-3eb9-49a1-b632-2b1ac6010a96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:29.709449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:29.710399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:29.711232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 289/568] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:29.711946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055815d1-37f7-4ffc-8647-9b64b842eee2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.711946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055815d1-37f7-4ffc-8647-9b64b842eee2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.712234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055815d1-37f7-4ffc-8647-9b64b842eee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.730756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-055815d1-37f7-4ffc-8647-9b64b842eee2 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:29.732041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-055815d1-37f7-4ffc-8647-9b64b842eee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:29.768418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c69e41-00fe-460b-8050-331cc3bb2f52 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.798354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 290/569] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:29.799024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055815d1-37f7-4ffc-8647-9b64b842eee2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.800911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be562e0b-842d-45a4-ac69-89cb7390fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.801520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562e0b-842d-45a4-ac69-89cb7390fa37 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.801793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562e0b-842d-45a4-ac69-89cb7390fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.802058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562e0b-842d-45a4-ac69-89cb7390fa37 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.802695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be562e0b-842d-45a4-ac69-89cb7390fa37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:29.802991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be562e0b-842d-45a4-ac69-89cb7390fa37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:29.804400 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be562e0b-842d-45a4-ac69-89cb7390fa37 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:29.816229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 280/570] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:29.817031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be562e0b-842d-45a4-ac69-89cb7390fa37 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.875132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:29.899192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:29.921394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055815d1-37f7-4ffc-8647-9b64b842eee2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.928105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be562e0b-842d-45a4-ac69-89cb7390fa37 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:29.960123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a8e66-4fc8-46a1-abc2-9b7e114252b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.961015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a8e66-4fc8-46a1-abc2-9b7e114252b8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.961445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a8e66-4fc8-46a1-abc2-9b7e114252b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.961847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a8e66-4fc8-46a1-abc2-9b7e114252b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.962616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a8e66-4fc8-46a1-abc2-9b7e114252b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:29.963050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a8e66-4fc8-46a1-abc2-9b7e114252b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:29.963552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372c31e-c96f-4989-8857-325d79da93ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:29.964158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372c31e-c96f-4989-8857-325d79da93ba None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:29.964431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372c31e-c96f-4989-8857-325d79da93ba None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:29.964699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372c31e-c96f-4989-8857-325d79da93ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:29.965414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372c31e-c96f-4989-8857-325d79da93ba None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=85602a9d62bc475fb5da609f97958d5f) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:29.965723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372c31e-c96f-4989-8857-325d79da93ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:29.965831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a8e66-4fc8-46a1-abc2-9b7e114252b8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:29.967321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372c31e-c96f-4989-8857-325d79da93ba None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:29.973675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 281/571] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/role_assignments?user.id=85602a9d62bc475fb5da609f97958d5f&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:29.974904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372c31e-c96f-4989-8857-325d79da93ba None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:29.977571 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 291/572] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:29.978644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a8e66-4fc8-46a1-abc2-9b7e114252b8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.097331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a8e66-4fc8-46a1-abc2-9b7e114252b8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.115790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:30.117612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372c31e-c96f-4989-8857-325d79da93ba None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.137140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c886b-7342-468a-99ff-e996c854e822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:30.137704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c886b-7342-468a-99ff-e996c854e822 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:30.137971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c886b-7342-468a-99ff-e996c854e822 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:30.138227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c886b-7342-468a-99ff-e996c854e822 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:30.148122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c886b-7342-468a-99ff-e996c854e822 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:30.149734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c886b-7342-468a-99ff-e996c854e822 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:30.156427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700814-c554-413b-9d13-6456cb1b0b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:30.157046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700814-c554-413b-9d13-6456cb1b0b9c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:30.157318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700814-c554-413b-9d13-6456cb1b0b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:30.157585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700814-c554-413b-9d13-6456cb1b0b9c None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:30.158263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69700814-c554-413b-9d13-6456cb1b0b9c None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:30.158588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69700814-c554-413b-9d13-6456cb1b0b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:30.160002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69700814-c554-413b-9d13-6456cb1b0b9c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8c0c886b-7342-468a-99ff-e996c854e822 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:30.162960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:30.163998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 292/573] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:30.164950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c886b-7342-468a-99ff-e996c854e822 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.170658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:30.181077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 282/574] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:30.181873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700814-c554-413b-9d13-6456cb1b0b9c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.278697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c886b-7342-468a-99ff-e996c854e822 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.282058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700814-c554-413b-9d13-6456cb1b0b9c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.313543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867346ab-931f-472d-90c4-8237a7624c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:30.314188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867346ab-931f-472d-90c4-8237a7624c97 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:30.314492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867346ab-931f-472d-90c4-8237a7624c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:30.314855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867346ab-931f-472d-90c4-8237a7624c97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:30.324015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867346ab-931f-472d-90c4-8237a7624c97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:30.324591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be780d77-bf33-4eb9-9748-ebb4f2a8d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:30.325231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780d77-bf33-4eb9-9748-ebb4f2a8d4db None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:30.325507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780d77-bf33-4eb9-9748-ebb4f2a8d4db None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:30.325602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867346ab-931f-472d-90c4-8237a7624c97 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:30.325775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780d77-bf33-4eb9-9748-ebb4f2a8d4db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:30.336816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be780d77-bf33-4eb9-9748-ebb4f2a8d4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-867346ab-931f-472d-90c4-8237a7624c97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:30.337344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:30.338257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:30.339242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:30.339242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:30.339242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:30.339242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:30.339242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:30.339242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:30.339242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:30.339242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:30.339242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:30.339242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-be780d77-bf33-4eb9-9748-ebb4f2a8d4db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:30.341552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:30.342640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 283/575] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:30.345320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be780d77-bf33-4eb9-9748-ebb4f2a8d4db None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.348328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 293/576] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 6 04:19:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:30.348503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867346ab-931f-472d-90c4-8237a7624c97 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.386765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:30.404751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:30.447614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be780d77-bf33-4eb9-9748-ebb4f2a8d4db None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.458067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867346ab-931f-472d-90c4-8237a7624c97 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.484797 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75830d0f-3f07-4f56-8dcd-8a46cb09f4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:30.485397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75830d0f-3f07-4f56-8dcd-8a46cb09f4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:30.485774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75830d0f-3f07-4f56-8dcd-8a46cb09f4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:30.486036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75830d0f-3f07-4f56-8dcd-8a46cb09f4a1 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:30.486869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75830d0f-3f07-4f56-8dcd-8a46cb09f4a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:30.487155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75830d0f-3f07-4f56-8dcd-8a46cb09f4a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:30.488731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75830d0f-3f07-4f56-8dcd-8a46cb09f4a1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:30.494267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726e4ab-fd69-4838-960d-c4ab14380e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:30.494956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726e4ab-fd69-4838-960d-c4ab14380e25 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:30.495236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726e4ab-fd69-4838-960d-c4ab14380e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:30.495533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726e4ab-fd69-4838-960d-c4ab14380e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:30.511872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 284/577] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Oct 6 04:19:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:30.512063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726e4ab-fd69-4838-960d-c4ab14380e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:30.512184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75830d0f-3f07-4f56-8dcd-8a46cb09f4a1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.512276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726e4ab-fd69-4838-960d-c4ab14380e25 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a726e4ab-fd69-4838-960d-c4ab14380e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:30.525838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:30.526824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:30.533449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:30.533449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:30.533449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:30.533449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 294/578] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:30.533449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726e4ab-fd69-4838-960d-c4ab14380e25 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.614210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75830d0f-3f07-4f56-8dcd-8a46cb09f4a1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.630523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:30.635884 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:30.644939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726e4ab-fd69-4838-960d-c4ab14380e25 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.650154 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28d761-5dea-4a92-9f12-4d24d8fba9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:30.650764 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28d761-5dea-4a92-9f12-4d24d8fba9bd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:30.651035 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28d761-5dea-4a92-9f12-4d24d8fba9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:30.651313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28d761-5dea-4a92-9f12-4d24d8fba9bd None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:30.652049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28d761-5dea-4a92-9f12-4d24d8fba9bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:30.652337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28d761-5dea-4a92-9f12-4d24d8fba9bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:30.653773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28d761-5dea-4a92-9f12-4d24d8fba9bd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:30.676991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 285/579] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 6 04:19:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:30.678152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28d761-5dea-4a92-9f12-4d24d8fba9bd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.680932 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2db51-9352-479a-8ccc-ec84f7ef3d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:30.681550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2db51-9352-479a-8ccc-ec84f7ef3d7f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:30.681819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2db51-9352-479a-8ccc-ec84f7ef3d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:30.682082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2db51-9352-479a-8ccc-ec84f7ef3d7f None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:30.682753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2db51-9352-479a-8ccc-ec84f7ef3d7f None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:30.683051 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2db51-9352-479a-8ccc-ec84f7ef3d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:30.684453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2db51-9352-479a-8ccc-ec84f7ef3d7f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:30.697772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 295/580] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:30.697772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2db51-9352-479a-8ccc-ec84f7ef3d7f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.783989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28d761-5dea-4a92-9f12-4d24d8fba9bd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.811065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2db51-9352-479a-8ccc-ec84f7ef3d7f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.819117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4681d-9ae3-4d83-9c86-33577a836bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:30.819909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4681d-9ae3-4d83-9c86-33577a836bde None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:30.820185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4681d-9ae3-4d83-9c86-33577a836bde None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:30.820515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4681d-9ae3-4d83-9c86-33577a836bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:30.830735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4681d-9ae3-4d83-9c86-33577a836bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:30.832261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4681d-9ae3-4d83-9c86-33577a836bde None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-9bc4681d-9ae3-4d83-9c86-33577a836bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:30.847230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:30.848684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:30.849925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:30.849925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:30.849925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:30.850107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783682b9-0e97-4004-a855-ca7a55f3e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:30.850107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783682b9-0e97-4004-a855-ca7a55f3e610 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:30.850409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783682b9-0e97-4004-a855-ca7a55f3e610 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:30.850561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783682b9-0e97-4004-a855-ca7a55f3e610 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:30.851232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783682b9-0e97-4004-a855-ca7a55f3e610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:30.851585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783682b9-0e97-4004-a855-ca7a55f3e610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:30.853185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783682b9-0e97-4004-a855-ca7a55f3e610 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:30.853321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 286/581] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:30.854233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4681d-9ae3-4d83-9c86-33577a836bde None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.868532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 296/582] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:30.869392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783682b9-0e97-4004-a855-ca7a55f3e610 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:30.883613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:30.891943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:30.966510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4681d-9ae3-4d83-9c86-33577a836bde None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:30.980999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783682b9-0e97-4004-a855-ca7a55f3e610 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.002406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d6b6-9c82-4d76-9dc3-a7dc37613493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.003034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d6b6-9c82-4d76-9dc3-a7dc37613493 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.003326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d6b6-9c82-4d76-9dc3-a7dc37613493 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.003673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d6b6-9c82-4d76-9dc3-a7dc37613493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.014780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97d6b6-9c82-4d76-9dc3-a7dc37613493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.016337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97d6b6-9c82-4d76-9dc3-a7dc37613493 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.017383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445853-852a-4db5-949e-63cecf39b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.018175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445853-852a-4db5-949e-63cecf39b48a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.018450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445853-852a-4db5-949e-63cecf39b48a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.019021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445853-852a-4db5-949e-63cecf39b48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1b97d6b6-9c82-4d76-9dc3-a7dc37613493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:31.029954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:31.030923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:31.036647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:31.036647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:31.036647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:31.036830 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82445853-852a-4db5-949e-63cecf39b48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.036830 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82445853-852a-4db5-949e-63cecf39b48a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.036961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 287/583] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:31.036961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d6b6-9c82-4d76-9dc3-a7dc37613493 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-82445853-852a-4db5-949e-63cecf39b48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:31.052411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:31.053372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:31.054258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:31.054258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:31.054258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:31.054258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 297/584] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:31.054258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445853-852a-4db5-949e-63cecf39b48a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.119523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:31.124566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:31.146144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d6b6-9c82-4d76-9dc3-a7dc37613493 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.163110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445853-852a-4db5-949e-63cecf39b48a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.180079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2730-d655-4c9d-bb6e-2f1e08286b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.180783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2730-d655-4c9d-bb6e-2f1e08286b42 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.180971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2730-d655-4c9d-bb6e-2f1e08286b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.181243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2730-d655-4c9d-bb6e-2f1e08286b42 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.182097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2730-d655-4c9d-bb6e-2f1e08286b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:31.182213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2730-d655-4c9d-bb6e-2f1e08286b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.183576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2730-d655-4c9d-bb6e-2f1e08286b42 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.196162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 288/585] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:31.196942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2730-d655-4c9d-bb6e-2f1e08286b42 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.206148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ef847-14cb-401a-bb06-a385d9112ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.206796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ef847-14cb-401a-bb06-a385d9112ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.207071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ef847-14cb-401a-bb06-a385d9112ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.207814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ef847-14cb-401a-bb06-a385d9112ad9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.216690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ef847-14cb-401a-bb06-a385d9112ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.218512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ef847-14cb-401a-bb06-a385d9112ad9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0f9ef847-14cb-401a-bb06-a385d9112ad9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:31.231894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:31.232847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:31.234138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 298/586] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:31.235080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ef847-14cb-401a-bb06-a385d9112ad9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.310002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2730-d655-4c9d-bb6e-2f1e08286b42 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.348404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf7bf7-87ff-4c68-9d56-d1d174329f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.349021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7bf7-87ff-4c68-9d56-d1d174329f79 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.349298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7bf7-87ff-4c68-9d56-d1d174329f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.349567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7bf7-87ff-4c68-9d56-d1d174329f79 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.350210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf7bf7-87ff-4c68-9d56-d1d174329f79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:31.350510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf7bf7-87ff-4c68-9d56-d1d174329f79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.350606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ef847-14cb-401a-bb06-a385d9112ad9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.351961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf7bf7-87ff-4c68-9d56-d1d174329f79 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.361476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:31.364935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 289/587] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:31.365829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf7bf7-87ff-4c68-9d56-d1d174329f79 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.378443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:31.392164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762698e-33fd-4d42-9b50-114235da35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.392819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762698e-33fd-4d42-9b50-114235da35be None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.393092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762698e-33fd-4d42-9b50-114235da35be None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.393357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762698e-33fd-4d42-9b50-114235da35be None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.393992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762698e-33fd-4d42-9b50-114235da35be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:31.394289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762698e-33fd-4d42-9b50-114235da35be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.395695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762698e-33fd-4d42-9b50-114235da35be None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.412545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 299/588] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:31.412545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762698e-33fd-4d42-9b50-114235da35be None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.476444 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf7bf7-87ff-4c68-9d56-d1d174329f79 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.510224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0edfe-a161-4d26-9961-3388274dadf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.510853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0edfe-a161-4d26-9961-3388274dadf2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.511123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0edfe-a161-4d26-9961-3388274dadf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.511416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0edfe-a161-4d26-9961-3388274dadf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.514761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762698e-33fd-4d42-9b50-114235da35be None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.518008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0edfe-a161-4d26-9961-3388274dadf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.519505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0edfe-a161-4d26-9961-3388274dadf2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a3d0edfe-a161-4d26-9961-3388274dadf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:31.531028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:31.532128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:31.533103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:31.533103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:31.533103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:31.533103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:31.533103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:31.533103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:31.533103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:31.533103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:31.533103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 290/589] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:31.533103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0edfe-a161-4d26-9961-3388274dadf2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.558743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f9ed1-f6dc-45e0-b10b-5688b70f82d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.559386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f9ed1-f6dc-45e0-b10b-5688b70f82d2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.559662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f9ed1-f6dc-45e0-b10b-5688b70f82d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.559926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f9ed1-f6dc-45e0-b10b-5688b70f82d2 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.560658 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f9ed1-f6dc-45e0-b10b-5688b70f82d2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:31.560955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f9ed1-f6dc-45e0-b10b-5688b70f82d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.562475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f9ed1-f6dc-45e0-b10b-5688b70f82d2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.581154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 300/590] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:31.581957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f9ed1-f6dc-45e0-b10b-5688b70f82d2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.609718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:31.628327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:31.656454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0edfe-a161-4d26-9961-3388274dadf2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.691754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f9ed1-f6dc-45e0-b10b-5688b70f82d2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.692195 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86111b-e202-4cee-948a-dc8d4b9b5489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.692831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86111b-e202-4cee-948a-dc8d4b9b5489 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.693148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86111b-e202-4cee-948a-dc8d4b9b5489 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.693379 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86111b-e202-4cee-948a-dc8d4b9b5489 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.700550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86111b-e202-4cee-948a-dc8d4b9b5489 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.702329 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86111b-e202-4cee-948a-dc8d4b9b5489 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-7f86111b-e202-4cee-948a-dc8d4b9b5489 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:31.714203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:31.715165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:31.716088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:31.716088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:31.716088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:31.716088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:31.716088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:31.716088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:31.716088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:31.716088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:31.720102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 291/591] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:31.720823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86111b-e202-4cee-948a-dc8d4b9b5489 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.731096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9f479-df19-47b4-89eb-aadf8cca10a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.732096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9f479-df19-47b4-89eb-aadf8cca10a9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.732409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9f479-df19-47b4-89eb-aadf8cca10a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.732654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9f479-df19-47b4-89eb-aadf8cca10a9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.741978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9f479-df19-47b4-89eb-aadf8cca10a9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.743641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9f479-df19-47b4-89eb-aadf8cca10a9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-24b9f479-df19-47b4-89eb-aadf8cca10a9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:31.756063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:31.757157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 301/592] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:31.763104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9f479-df19-47b4-89eb-aadf8cca10a9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.844646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86111b-e202-4cee-948a-dc8d4b9b5489 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.867662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:31.872853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9f479-df19-47b4-89eb-aadf8cca10a9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:31.874948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:31.892229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c951ddf-c53a-4c64-a38e-8e9016a436a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.892834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c951ddf-c53a-4c64-a38e-8e9016a436a8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.893110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c951ddf-c53a-4c64-a38e-8e9016a436a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.893383 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c951ddf-c53a-4c64-a38e-8e9016a436a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.894082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c951ddf-c53a-4c64-a38e-8e9016a436a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:31.894392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c951ddf-c53a-4c64-a38e-8e9016a436a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.895873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c951ddf-c53a-4c64-a38e-8e9016a436a8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.909207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 292/593] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:31.909845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c951ddf-c53a-4c64-a38e-8e9016a436a8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:31.915522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656e41d-1acf-42ee-a76e-f78da892180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:31.916270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656e41d-1acf-42ee-a76e-f78da892180a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:31.916673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656e41d-1acf-42ee-a76e-f78da892180a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:31.917015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656e41d-1acf-42ee-a76e-f78da892180a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:31.933473 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656e41d-1acf-42ee-a76e-f78da892180a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:31.935127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656e41d-1acf-42ee-a76e-f78da892180a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b656e41d-1acf-42ee-a76e-f78da892180a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:31.951190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:31.952307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:31.953359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:31.953359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:31.953359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:31.953359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 302/594] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:31.953622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656e41d-1acf-42ee-a76e-f78da892180a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:32.019580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c951ddf-c53a-4c64-a38e-8e9016a436a8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:32.057709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f3a1-62b6-4419-83f9-f0b35271ff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:32.058319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f3a1-62b6-4419-83f9-f0b35271ff2b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.058590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f3a1-62b6-4419-83f9-f0b35271ff2b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.058862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f3a1-62b6-4419-83f9-f0b35271ff2b None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.059579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4f3a1-62b6-4419-83f9-f0b35271ff2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:32.059879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4f3a1-62b6-4419-83f9-f0b35271ff2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:32.061302 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4f3a1-62b6-4419-83f9-f0b35271ff2b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:32.071106 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656e41d-1acf-42ee-a76e-f78da892180a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:32.073737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 293/595] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:32.074649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f3a1-62b6-4419-83f9-f0b35271ff2b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:32.108843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8e023-1ac3-41a0-898f-f49adf65c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:32.109455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e023-1ac3-41a0-898f-f49adf65c3ea None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.109726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e023-1ac3-41a0-898f-f49adf65c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.109977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e023-1ac3-41a0-898f-f49adf65c3ea None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.110709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8e023-1ac3-41a0-898f-f49adf65c3ea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:32.110990 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8e023-1ac3-41a0-898f-f49adf65c3ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:32.112446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8e023-1ac3-41a0-898f-f49adf65c3ea None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:32.114995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:32.132355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 303/596] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Oct 6 04:19:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:32.133930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8e023-1ac3-41a0-898f-f49adf65c3ea None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:32.148970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:32.181783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f3a1-62b6-4419-83f9-f0b35271ff2b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:32.214122 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ec25e-70a2-4fc0-9a37-2aac1903f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:32.214800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ec25e-70a2-4fc0-9a37-2aac1903f791 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.215075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ec25e-70a2-4fc0-9a37-2aac1903f791 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.215349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ec25e-70a2-4fc0-9a37-2aac1903f791 None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/457880195ed849d2b594ddea6acdf7df/roles/b62720b095b548c38bc8740a29e49cb2` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.230201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ec25e-70a2-4fc0-9a37-2aac1903f791 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=457880195ed849d2b594ddea6acdf7df, role_id=b62720b095b548c38bc8740a29e49cb2)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:32.231696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ec25e-70a2-4fc0-9a37-2aac1903f791 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:32.237157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8e023-1ac3-41a0-898f-f49adf65c3ea None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:32.244866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 294/597] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:19:32 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/457880195ed849d2b594ddea6acdf7df/roles/b62720b095b548c38bc8740a29e49cb2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:19:32.245635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ec25e-70a2-4fc0-9a37-2aac1903f791 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:32.282205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a56ee-29ed-40bf-bbea-521b4d8f2b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:32.283156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a56ee-29ed-40bf-bbea-521b4d8f2b7c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.283484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a56ee-29ed-40bf-bbea-521b4d8f2b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.283843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a56ee-29ed-40bf-bbea-521b4d8f2b7c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.284512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a56ee-29ed-40bf-bbea-521b4d8f2b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:32.284806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a56ee-29ed-40bf-bbea-521b4d8f2b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:32.286271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a56ee-29ed-40bf-bbea-521b4d8f2b7c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:32.303048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 304/598] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:32.303048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a56ee-29ed-40bf-bbea-521b4d8f2b7c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:32.358269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:32.371335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ec25e-70a2-4fc0-9a37-2aac1903f791 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:32.383261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:32.407114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd3b53-e43a-4db0-a6b1-f778d2d314e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:32.407920 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd3b53-e43a-4db0-a6b1-f778d2d314e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.408196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd3b53-e43a-4db0-a6b1-f778d2d314e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.408465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd3b53-e43a-4db0-a6b1-f778d2d314e7 None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/0481d4c0be0b46189e339d1e00bee4c0/roles/b62720b095b548c38bc8740a29e49cb2` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.420384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a56ee-29ed-40bf-bbea-521b4d8f2b7c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:32.430012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd3b53-e43a-4db0-a6b1-f778d2d314e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=0481d4c0be0b46189e339d1e00bee4c0, role_id=b62720b095b548c38bc8740a29e49cb2)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:32.430359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd3b53-e43a-4db0-a6b1-f778d2d314e7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:32.449424 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 295/599] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:19:32 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/0481d4c0be0b46189e339d1e00bee4c0/roles/b62720b095b548c38bc8740a29e49cb2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:19:32.450744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70391a5-fd1b-4c94-9e00-1a0418e7f32d None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.451038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70391a5-fd1b-4c94-9e00-1a0418e7f32d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.451327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70391a5-fd1b-4c94-9e00-1a0418e7f32d None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.452765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 296/600] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:32.453886 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70391a5-fd1b-4c94-9e00-1a0418e7f32d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:32.471267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ade44-e822-4507-bc0f-685ac88cc432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:32.472347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ade44-e822-4507-bc0f-685ac88cc432 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.472706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ade44-e822-4507-bc0f-685ac88cc432 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.473041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ade44-e822-4507-bc0f-685ac88cc432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.487689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ade44-e822-4507-bc0f-685ac88cc432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:32.489576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ade44-e822-4507-bc0f-685ac88cc432 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-892ade44-e822-4507-bc0f-685ac88cc432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:32.508689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:32.509986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:32.511031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:32.511031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:32.511031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:32.511442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 305/601] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:32.512808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fb1b-bb3e-40b7-8244-a64a6cef5105 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.513198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fb1b-bb3e-40b7-8244-a64a6cef5105 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.513565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fb1b-bb3e-40b7-8244-a64a6cef5105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.535879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-19c7fb1b-bb3e-40b7-8244-a64a6cef5105 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:32.537212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-19c7fb1b-bb3e-40b7-8244-a64a6cef5105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:32.579503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70391a5-fd1b-4c94-9e00-1a0418e7f32d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:32.622438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 306/602] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:32.623142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca861369-e8b7-430f-b364-b5ae35b9b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:32.623375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7fb1b-bb3e-40b7-8244-a64a6cef5105 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:32.624392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861369-e8b7-430f-b364-b5ae35b9b060 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.624920 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861369-e8b7-430f-b364-b5ae35b9b060 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.625425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861369-e8b7-430f-b364-b5ae35b9b060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.633607 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca861369-e8b7-430f-b364-b5ae35b9b060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:32.635521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca861369-e8b7-430f-b364-b5ae35b9b060 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:32.638770 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ca861369-e8b7-430f-b364-b5ae35b9b060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:32.650428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:32.651445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:32.652336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:32.652336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:32.652336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:32.652336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:32.652336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:32.652336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:32.652336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:32.652336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:32.652336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 297/603] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:32.658172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca861369-e8b7-430f-b364-b5ae35b9b060 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:32.687269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:32.743169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7fb1b-bb3e-40b7-8244-a64a6cef5105 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:32.773514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca861369-e8b7-430f-b364-b5ae35b9b060 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:32.786320 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd113b-1eef-45df-8167-faa25b9af30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:32.786869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd113b-1eef-45df-8167-faa25b9af30e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.787145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd113b-1eef-45df-8167-faa25b9af30e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.787446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd113b-1eef-45df-8167-faa25b9af30e None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.788506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd113b-1eef-45df-8167-faa25b9af30e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:32.788808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd113b-1eef-45df-8167-faa25b9af30e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:32.790476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd113b-1eef-45df-8167-faa25b9af30e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:32.804444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 307/604] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:32.810590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd113b-1eef-45df-8167-faa25b9af30e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:32.822371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516da48-ee8e-4084-9e97-c93323046756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:32.823824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516da48-ee8e-4084-9e97-c93323046756 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:32.824321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516da48-ee8e-4084-9e97-c93323046756 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:32.825137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516da48-ee8e-4084-9e97-c93323046756 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:32.826310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516da48-ee8e-4084-9e97-c93323046756 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:32.826805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516da48-ee8e-4084-9e97-c93323046756 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:32.829332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516da48-ee8e-4084-9e97-c93323046756 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:32.849330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 298/605] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:32.855681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516da48-ee8e-4084-9e97-c93323046756 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:32.964238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:32.966298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd113b-1eef-45df-8167-faa25b9af30e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:32.982313 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:33.007879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a89eb-8546-4827-8bb3-64c9d71309a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:33.008631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a89eb-8546-4827-8bb3-64c9d71309a2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:33.008909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a89eb-8546-4827-8bb3-64c9d71309a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:33.009176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a89eb-8546-4827-8bb3-64c9d71309a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:33.012931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516da48-ee8e-4084-9e97-c93323046756 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:33.017373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a89eb-8546-4827-8bb3-64c9d71309a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:33.018822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a89eb-8546-4827-8bb3-64c9d71309a2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-531a89eb-8546-4827-8bb3-64c9d71309a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:33.032327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:33.033239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:33.034564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:33.034564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:33.034564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:33.034564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:33.034564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:33.034564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:33.034564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:33.034564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:33.034564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 308/606] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:33.034564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a89eb-8546-4827-8bb3-64c9d71309a2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:33.065712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca84ba-f4bf-49d8-a46c-e7976fc29e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:33.066377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca84ba-f4bf-49d8-a46c-e7976fc29e6a None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:33.066561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca84ba-f4bf-49d8-a46c-e7976fc29e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:33.066820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca84ba-f4bf-49d8-a46c-e7976fc29e6a None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/e66a78c94f03443cbae595bba07e458d/roles/b62720b095b548c38bc8740a29e49cb2` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:33.088897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca84ba-f4bf-49d8-a46c-e7976fc29e6a None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=e66a78c94f03443cbae595bba07e458d, role_id=b62720b095b548c38bc8740a29e49cb2)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:33.090395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca84ba-f4bf-49d8-a46c-e7976fc29e6a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:33.108102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 299/607] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:19:32 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/e66a78c94f03443cbae595bba07e458d/roles/b62720b095b548c38bc8740a29e49cb2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:19:33.109160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca84ba-f4bf-49d8-a46c-e7976fc29e6a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:33.188910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a89eb-8546-4827-8bb3-64c9d71309a2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:33.276586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1241f02-50cb-4cb2-ad8a-66afa8623502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:33.277242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1241f02-50cb-4cb2-ad8a-66afa8623502 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:33.277522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1241f02-50cb-4cb2-ad8a-66afa8623502 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:33.277790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1241f02-50cb-4cb2-ad8a-66afa8623502 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:33.292994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca84ba-f4bf-49d8-a46c-e7976fc29e6a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:33.301073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1241f02-50cb-4cb2-ad8a-66afa8623502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:33.306009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f1241f02-50cb-4cb2-ad8a-66afa8623502 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:33.306456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:33.307619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:33.308693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:33.316272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 309/608] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:33.325160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1241f02-50cb-4cb2-ad8a-66afa8623502 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:33.351517 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10987c44-c367-4b64-92f6-838e8e7d15cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:33.352423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987c44-c367-4b64-92f6-838e8e7d15cf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:33.352998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987c44-c367-4b64-92f6-838e8e7d15cf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:33.353421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987c44-c367-4b64-92f6-838e8e7d15cf None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:33.354310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10987c44-c367-4b64-92f6-838e8e7d15cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:33.354774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10987c44-c367-4b64-92f6-838e8e7d15cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:33.356501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10987c44-c367-4b64-92f6-838e8e7d15cf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:33.363908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:33.372069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 300/609] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:33.378974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10987c44-c367-4b64-92f6-838e8e7d15cf None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:33.454396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1241f02-50cb-4cb2-ad8a-66afa8623502 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:33.493567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd0dcf-0e2f-4762-a2e2-015482f59e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:33.494382 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd0dcf-0e2f-4762-a2e2-015482f59e2d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:33.494513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd0dcf-0e2f-4762-a2e2-015482f59e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:33.494698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd0dcf-0e2f-4762-a2e2-015482f59e2d None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:33.495415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd0dcf-0e2f-4762-a2e2-015482f59e2d None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:33.495699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd0dcf-0e2f-4762-a2e2-015482f59e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:33.497057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd0dcf-0e2f-4762-a2e2-015482f59e2d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:33.497992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10987c44-c367-4b64-92f6-838e8e7d15cf None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:33.505850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 310/610] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:33.511318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd0dcf-0e2f-4762-a2e2-015482f59e2d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:33.571428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb576bc-19fa-4f62-84ee-21f02b23da33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:33.572024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb576bc-19fa-4f62-84ee-21f02b23da33 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:33.572305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb576bc-19fa-4f62-84ee-21f02b23da33 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:33.572573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb576bc-19fa-4f62-84ee-21f02b23da33 None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/39ca0a824c4740dbb911bb1a38cfc47b/roles/b62720b095b548c38bc8740a29e49cb2` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:33.604773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb576bc-19fa-4f62-84ee-21f02b23da33 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=39ca0a824c4740dbb911bb1a38cfc47b, role_id=b62720b095b548c38bc8740a29e49cb2)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:33.606254 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb576bc-19fa-4f62-84ee-21f02b23da33 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:33.635634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 301/611] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:19:33 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/39ca0a824c4740dbb911bb1a38cfc47b/roles/b62720b095b548c38bc8740a29e49cb2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:19:33.644270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:33.651626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd0dcf-0e2f-4762-a2e2-015482f59e2d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:33.689351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893cd30-b0f7-486e-b66b-2d5e930f11b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:33.689997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893cd30-b0f7-486e-b66b-2d5e930f11b4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:33.690271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893cd30-b0f7-486e-b66b-2d5e930f11b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:33.690537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893cd30-b0f7-486e-b66b-2d5e930f11b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:33.702649 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893cd30-b0f7-486e-b66b-2d5e930f11b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:33.704152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893cd30-b0f7-486e-b66b-2d5e930f11b4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f893cd30-b0f7-486e-b66b-2d5e930f11b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:33.719579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:33.720615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:33.721550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:33.721550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:33.721550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:33.721550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 311/612] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:33.728844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb576bc-19fa-4f62-84ee-21f02b23da33 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:33.778990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:33.914434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb576bc-19fa-4f62-84ee-21f02b23da33 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:33.955919 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73261391-60aa-4e60-9095-3f97912ac908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:33.956917 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73261391-60aa-4e60-9095-3f97912ac908 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:33.957393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73261391-60aa-4e60-9095-3f97912ac908 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:33.957860 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73261391-60aa-4e60-9095-3f97912ac908 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:33.958750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73261391-60aa-4e60-9095-3f97912ac908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:33.959244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73261391-60aa-4e60-9095-3f97912ac908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:33.960918 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73261391-60aa-4e60-9095-3f97912ac908 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:33.976800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 302/613] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:33.982810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893cd30-b0f7-486e-b66b-2d5e930f11b4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:34.116858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893cd30-b0f7-486e-b66b-2d5e930f11b4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:34.169134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8812b-7b9e-4d9f-bb48-eb23207f25b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:34.170137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8812b-7b9e-4d9f-bb48-eb23207f25b0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:34.170632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8812b-7b9e-4d9f-bb48-eb23207f25b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:34.171092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8812b-7b9e-4d9f-bb48-eb23207f25b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:34.179816 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8812b-7b9e-4d9f-bb48-eb23207f25b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:34.181588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8812b-7b9e-4d9f-bb48-eb23207f25b0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8bd8812b-7b9e-4d9f-bb48-eb23207f25b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:34.194344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:34.195407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:34.196365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:34.196365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:34.196365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:34.196365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:34.196365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:34.196365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:34.196365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:34.196365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:34.196365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:34.196365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:34.198934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 312/614] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:34.205834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73261391-60aa-4e60-9095-3f97912ac908 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:34.330767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:34.352557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73261391-60aa-4e60-9095-3f97912ac908 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:34.401229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9ab59-8050-46c4-8c1e-50f87c873bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:34.402356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9ab59-8050-46c4-8c1e-50f87c873bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:34.402865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9ab59-8050-46c4-8c1e-50f87c873bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:34.403440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9ab59-8050-46c4-8c1e-50f87c873bc2 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:34.404376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9ab59-8050-46c4-8c1e-50f87c873bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:34.404891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9ab59-8050-46c4-8c1e-50f87c873bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:34.406784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9ab59-8050-46c4-8c1e-50f87c873bc2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:34.433794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 303/615] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 6 04:19:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:34.439713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8812b-7b9e-4d9f-bb48-eb23207f25b0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:34.450478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:34.569565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8812b-7b9e-4d9f-bb48-eb23207f25b0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:34.617397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faae429-41a0-40e7-8901-4adcfc8e5e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:34.618442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faae429-41a0-40e7-8901-4adcfc8e5e6f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:34.618914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faae429-41a0-40e7-8901-4adcfc8e5e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:34.619396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faae429-41a0-40e7-8901-4adcfc8e5e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:34.633421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faae429-41a0-40e7-8901-4adcfc8e5e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:34.634930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faae429-41a0-40e7-8901-4adcfc8e5e6f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7faae429-41a0-40e7-8901-4adcfc8e5e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:34.660102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:34.661112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:34.662008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:34.662008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:34.662008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:34.662008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 313/616] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:34.667566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9ab59-8050-46c4-8c1e-50f87c873bc2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:34.819281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9ab59-8050-46c4-8c1e-50f87c873bc2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:34.868076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833631-82cb-412e-962f-8477a0907824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:34.869101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833631-82cb-412e-962f-8477a0907824 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:34.869595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833631-82cb-412e-962f-8477a0907824 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:34.870061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833631-82cb-412e-962f-8477a0907824 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:34.870930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72833631-82cb-412e-962f-8477a0907824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:34.871460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72833631-82cb-412e-962f-8477a0907824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:34.873053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72833631-82cb-412e-962f-8477a0907824 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:34.880573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:34.887034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 304/617] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:34.896331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faae429-41a0-40e7-8901-4adcfc8e5e6f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:34.973054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:35.016726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faae429-41a0-40e7-8901-4adcfc8e5e6f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:35.057124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fb8e7-35b0-4a01-bf9a-a0f1bb19d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:35.057781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fb8e7-35b0-4a01-bf9a-a0f1bb19d84a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.058055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fb8e7-35b0-4a01-bf9a-a0f1bb19d84a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.058323 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fb8e7-35b0-4a01-bf9a-a0f1bb19d84a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.066338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fb8e7-35b0-4a01-bf9a-a0f1bb19d84a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:35.067841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fb8e7-35b0-4a01-bf9a-a0f1bb19d84a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5a0fb8e7-35b0-4a01-bf9a-a0f1bb19d84a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:35.081004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:35.082168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:35.083095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:35.083095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:35.083095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:35.083095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:35.083095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:35.083095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:35.083095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:35.083095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:35.083095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 314/618] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:35.088431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833631-82cb-412e-962f-8477a0907824 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:35.121442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb8390-85a1-407c-9f69-e7c7239255c9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.121768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb8390-85a1-407c-9f69-e7c7239255c9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.121983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb8390-85a1-407c-9f69-e7c7239255c9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.123328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 315/619] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:35.131497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a02c3-d682-4d94-8c6a-fe18017180d0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.131777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a02c3-d682-4d94-8c6a-fe18017180d0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.132030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a02c3-d682-4d94-8c6a-fe18017180d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.151608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-605a02c3-d682-4d94-8c6a-fe18017180d0 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:35.152799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-605a02c3-d682-4d94-8c6a-fe18017180d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:35.231453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 316/620] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:35.232596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106337-0ce5-4662-9afb-98517948d4b1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.232876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106337-0ce5-4662-9afb-98517948d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.233143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106337-0ce5-4662-9afb-98517948d4b1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.234697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 317/621] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:35.240049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb83e1-dc30-476f-b4c6-53d33037f745 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.240622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb83e1-dc30-476f-b4c6-53d33037f745 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.241464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb83e1-dc30-476f-b4c6-53d33037f745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.269007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4cfb83e1-dc30-476f-b4c6-53d33037f745 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:35.270198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4cfb83e1-dc30-476f-b4c6-53d33037f745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:35.288557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833631-82cb-412e-962f-8477a0907824 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:35.354646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7e6de-1024-4010-b3ff-87eebeac38c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:35.355192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7e6de-1024-4010-b3ff-87eebeac38c2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.355504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7e6de-1024-4010-b3ff-87eebeac38c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.355775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7e6de-1024-4010-b3ff-87eebeac38c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.356487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7e6de-1024-4010-b3ff-87eebeac38c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:35.356831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7e6de-1024-4010-b3ff-87eebeac38c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:35.358274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7e6de-1024-4010-b3ff-87eebeac38c2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:35.360187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:35.382874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 305/622] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:35.390250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7e6de-1024-4010-b3ff-87eebeac38c2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:35.396522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 318/623] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 04:19:35.481305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:35.533603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7e6de-1024-4010-b3ff-87eebeac38c2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:35.543774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb83e1-dc30-476f-b4c6-53d33037f745 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:35.593603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c611364-37af-45e2-b13e-f9c6d77e8abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:35.594277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c611364-37af-45e2-b13e-f9c6d77e8abf None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.594551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c611364-37af-45e2-b13e-f9c6d77e8abf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.594819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c611364-37af-45e2-b13e-f9c6d77e8abf None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/85602a9d62bc475fb5da609f97958d5f/roles/b62720b095b548c38bc8740a29e49cb2` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.627889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c611364-37af-45e2-b13e-f9c6d77e8abf None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=85602a9d62bc475fb5da609f97958d5f, role_id=b62720b095b548c38bc8740a29e49cb2)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:35.633772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c611364-37af-45e2-b13e-f9c6d77e8abf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:35.654463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 306/624] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:19:35 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/85602a9d62bc475fb5da609f97958d5f/roles/b62720b095b548c38bc8740a29e49cb2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:19:35.672554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb83e1-dc30-476f-b4c6-53d33037f745 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:35.717351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6acec2-d441-467d-a5b3-6f3100998d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:35.718657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6acec2-d441-467d-a5b3-6f3100998d9a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.719343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6acec2-d441-467d-a5b3-6f3100998d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.719910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6acec2-d441-467d-a5b3-6f3100998d9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.733902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6acec2-d441-467d-a5b3-6f3100998d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-df6acec2-d441-467d-a5b3-6f3100998d9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:35.739466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:35.740482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:35.741701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:35.744675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 319/625] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:35.751139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c611364-37af-45e2-b13e-f9c6d77e8abf None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:35.761857 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6acec2-d441-467d-a5b3-6f3100998d9a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:35.845013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:35.917656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c611364-37af-45e2-b13e-f9c6d77e8abf None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:35.922814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6acec2-d441-467d-a5b3-6f3100998d9a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:35.928476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:35.961986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab83a6-8810-49ba-875d-9d48ea2927db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:35.962619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab83a6-8810-49ba-875d-9d48ea2927db None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.962890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab83a6-8810-49ba-875d-9d48ea2927db None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.963153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab83a6-8810-49ba-875d-9d48ea2927db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.972187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a51e6-b2e4-4f89-9b09-b1a19d594cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:35.973125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a51e6-b2e4-4f89-9b09-b1a19d594cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.973753 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a51e6-b2e4-4f89-9b09-b1a19d594cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.974323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a51e6-b2e4-4f89-9b09-b1a19d594cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.974504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab83a6-8810-49ba-875d-9d48ea2927db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:35.975447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a51e6-b2e4-4f89-9b09-b1a19d594cd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:35.975962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a51e6-b2e4-4f89-9b09-b1a19d594cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:35.977568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a51e6-b2e4-4f89-9b09-b1a19d594cd7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5fab83a6-8810-49ba-875d-9d48ea2927db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:35.979582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:35.980499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:35.981330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 320/626] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:35.982500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aceebe-0163-4632-b199-27d44977b6cc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.982500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aceebe-0163-4632-b199-27d44977b6cc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.982653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aceebe-0163-4632-b199-27d44977b6cc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:35.988169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 321/627] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:35.989165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aceebe-0163-4632-b199-27d44977b6cc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:35.997918 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 307/628] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:35.999592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d745cb3-d584-476d-892f-e36638a0b63d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:35.999592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d745cb3-d584-476d-892f-e36638a0b63d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:35.999884 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d745cb3-d584-476d-892f-e36638a0b63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.023297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9d745cb3-d584-476d-892f-e36638a0b63d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:36.025044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9d745cb3-d584-476d-892f-e36638a0b63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:36.102373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:36.108485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aceebe-0163-4632-b199-27d44977b6cc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:36.115889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 308/629] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:36.117177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d745cb3-d584-476d-892f-e36638a0b63d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:36.147218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b78bfc-1a7e-4cb8-9d8e-66f5ded3970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:36.148345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b78bfc-1a7e-4cb8-9d8e-66f5ded3970a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.149010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b78bfc-1a7e-4cb8-9d8e-66f5ded3970a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.149494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b78bfc-1a7e-4cb8-9d8e-66f5ded3970a None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.150354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b78bfc-1a7e-4cb8-9d8e-66f5ded3970a None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:36.150931 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b78bfc-1a7e-4cb8-9d8e-66f5ded3970a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:36.152771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b78bfc-1a7e-4cb8-9d8e-66f5ded3970a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:36.163535 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 322/630] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:36.169815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b78bfc-1a7e-4cb8-9d8e-66f5ded3970a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:36.248812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:36.255027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d745cb3-d584-476d-892f-e36638a0b63d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:36.326681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b78bfc-1a7e-4cb8-9d8e-66f5ded3970a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:36.328663 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a3df4-8fb9-4f00-bab0-bf1edde7dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:36.329307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3df4-8fb9-4f00-bab0-bf1edde7dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.329583 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3df4-8fb9-4f00-bab0-bf1edde7dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.329845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3df4-8fb9-4f00-bab0-bf1edde7dcb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.349434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a3df4-8fb9-4f00-bab0-bf1edde7dcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:36.351297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a3df4-8fb9-4f00-bab0-bf1edde7dcb6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c57a3df4-8fb9-4f00-bab0-bf1edde7dcb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:36.375658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:36.376687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:36.377574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:36.377574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:36.377574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:36.379739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 309/631] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:36.383988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d34382-d55b-4f33-a269-d106908a9f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:36.384644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d34382-d55b-4f33-a269-d106908a9f1b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.384924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d34382-d55b-4f33-a269-d106908a9f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.385194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d34382-d55b-4f33-a269-d106908a9f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.385597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a3df4-8fb9-4f00-bab0-bf1edde7dcb6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:36.405242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d34382-d55b-4f33-a269-d106908a9f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:36.407122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d34382-d55b-4f33-a269-d106908a9f1b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-24d34382-d55b-4f33-a269-d106908a9f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:36.427831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:36.428796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:36.429727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:36.429727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:36.429727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:36.432346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 323/632] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:36.438456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d34382-d55b-4f33-a269-d106908a9f1b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:36.464602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:36.528258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a3df4-8fb9-4f00-bab0-bf1edde7dcb6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:36.566561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185da897-a2ed-48eb-a5cd-572421a35f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:36.567553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185da897-a2ed-48eb-a5cd-572421a35f8c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.568025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185da897-a2ed-48eb-a5cd-572421a35f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.568482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185da897-a2ed-48eb-a5cd-572421a35f8c None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.569472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185da897-a2ed-48eb-a5cd-572421a35f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:36.569982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185da897-a2ed-48eb-a5cd-572421a35f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:36.571678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185da897-a2ed-48eb-a5cd-572421a35f8c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:36.579025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d34382-d55b-4f33-a269-d106908a9f1b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:36.589219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 310/633] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:36.590426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185da897-a2ed-48eb-a5cd-572421a35f8c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:36.605841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:36.619363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe5173-6aa2-4346-b095-f8570fb08021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:36.620114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe5173-6aa2-4346-b095-f8570fb08021 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.620474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe5173-6aa2-4346-b095-f8570fb08021 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.620836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe5173-6aa2-4346-b095-f8570fb08021 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.621597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe5173-6aa2-4346-b095-f8570fb08021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:36.622087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe5173-6aa2-4346-b095-f8570fb08021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:36.624125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe5173-6aa2-4346-b095-f8570fb08021 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:36.639395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 324/634] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:36.640584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe5173-6aa2-4346-b095-f8570fb08021 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:36.703083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185da897-a2ed-48eb-a5cd-572421a35f8c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:36.719513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:36.739075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4a5bc-7a5f-4a72-92cc-05ad5ac38866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:36.739736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4a5bc-7a5f-4a72-92cc-05ad5ac38866 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.740007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4a5bc-7a5f-4a72-92cc-05ad5ac38866 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.740277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4a5bc-7a5f-4a72-92cc-05ad5ac38866 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.750427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe5173-6aa2-4346-b095-f8570fb08021 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:36.750644 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4a5bc-7a5f-4a72-92cc-05ad5ac38866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b9f4a5bc-7a5f-4a72-92cc-05ad5ac38866 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:36.755335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:36.756269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 311/635] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:36.760294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4a5bc-7a5f-4a72-92cc-05ad5ac38866 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:36.791435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639191d-384a-4cd0-ad1c-1730775629a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:36.792067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639191d-384a-4cd0-ad1c-1730775629a3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.792338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639191d-384a-4cd0-ad1c-1730775629a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.792599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639191d-384a-4cd0-ad1c-1730775629a3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.800223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639191d-384a-4cd0-ad1c-1730775629a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:36.801995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639191d-384a-4cd0-ad1c-1730775629a3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b639191d-384a-4cd0-ad1c-1730775629a3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:36.815880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:36.816854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:36.817798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 325/636] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:36.818410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc63ed-9df1-4a2b-b2ce-e040c4f945c5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.818410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc63ed-9df1-4a2b-b2ce-e040c4f945c5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.819384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc63ed-9df1-4a2b-b2ce-e040c4f945c5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.823561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 326/637] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:36.824600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc63ed-9df1-4a2b-b2ce-e040c4f945c5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:36.837198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:36.871362 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4a5bc-7a5f-4a72-92cc-05ad5ac38866 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:36.905256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d9cf7-fb40-446c-9538-fb0b88a4fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:36.906085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d9cf7-fb40-446c-9538-fb0b88a4fb4f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.906408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d9cf7-fb40-446c-9538-fb0b88a4fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.906566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d9cf7-fb40-446c-9538-fb0b88a4fb4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.914031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d9cf7-fb40-446c-9538-fb0b88a4fb4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:36.915515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d9cf7-fb40-446c-9538-fb0b88a4fb4f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4c9d9cf7-fb40-446c-9538-fb0b88a4fb4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:36.926911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:36.928160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 312/638] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 6 04:19:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:36.929102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d9cf7-fb40-446c-9538-fb0b88a4fb4f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:36.939888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc63ed-9df1-4a2b-b2ce-e040c4f945c5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:36.970114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:36.975682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8200e7-d5cc-4025-a65a-d3526c462b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:36.976277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8200e7-d5cc-4025-a65a-d3526c462b09 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.976547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8200e7-d5cc-4025-a65a-d3526c462b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.976807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8200e7-d5cc-4025-a65a-d3526c462b09 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:36.977493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8200e7-d5cc-4025-a65a-d3526c462b09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:36.977768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8200e7-d5cc-4025-a65a-d3526c462b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:36.979118 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8200e7-d5cc-4025-a65a-d3526c462b09 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:36.987931 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 327/639] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:36.989172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78267b1-510d-4a95-a7a6-99fe94aca5d7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:36.989449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78267b1-510d-4a95-a7a6-99fe94aca5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:36.989776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78267b1-510d-4a95-a7a6-99fe94aca5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:37.007765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e78267b1-510d-4a95-a7a6-99fe94aca5d7 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:37.009304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e78267b1-510d-4a95-a7a6-99fe94aca5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:37.054131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d9cf7-fb40-446c-9538-fb0b88a4fb4f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:37.084389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:37.090108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffa5bd-54de-49cd-8993-42ee682779ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:37.090719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa5bd-54de-49cd-8993-42ee682779ae None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:37.090991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa5bd-54de-49cd-8993-42ee682779ae None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:37.091257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa5bd-54de-49cd-8993-42ee682779ae None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:37.092007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffa5bd-54de-49cd-8993-42ee682779ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:37.092306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffa5bd-54de-49cd-8993-42ee682779ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:37.093879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffa5bd-54de-49cd-8993-42ee682779ae None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:37.099628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 328/640] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:37.100972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78267b1-510d-4a95-a7a6-99fe94aca5d7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:37.112294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 313/641] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Oct 6 04:19:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:37.113008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffa5bd-54de-49cd-8993-42ee682779ae None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:37.224509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78267b1-510d-4a95-a7a6-99fe94aca5d7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:37.230856 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffa5bd-54de-49cd-8993-42ee682779ae None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:37.252506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:37.265304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963ba4-379a-484b-b528-5c6b9356c239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:37.266150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963ba4-379a-484b-b528-5c6b9356c239 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:37.266626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963ba4-379a-484b-b528-5c6b9356c239 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:37.267067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963ba4-379a-484b-b528-5c6b9356c239 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:37.267995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39963ba4-379a-484b-b528-5c6b9356c239 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:37.268602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39963ba4-379a-484b-b528-5c6b9356c239 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:37.271030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39963ba4-379a-484b-b528-5c6b9356c239 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:37.276013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e70b-b970-4a8b-a90f-40327e367f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:37.276870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e70b-b970-4a8b-a90f-40327e367f9b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:37.277354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e70b-b970-4a8b-a90f-40327e367f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:37.277815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e70b-b970-4a8b-a90f-40327e367f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:37.288196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468e70b-b970-4a8b-a90f-40327e367f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:37.289887 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468e70b-b970-4a8b-a90f-40327e367f9b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:37.296712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 329/642] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 6 04:19:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:37.298014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963ba4-379a-484b-b528-5c6b9356c239 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-5468e70b-b970-4a8b-a90f-40327e367f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:37.309156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:37.310205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:37.311150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:37.311150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:37.311150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:37.313595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 314/643] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:37.314592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e70b-b970-4a8b-a90f-40327e367f9b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:37.361202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:37.409009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963ba4-379a-484b-b528-5c6b9356c239 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:37.421181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e70b-b970-4a8b-a90f-40327e367f9b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:37.445712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ca526-e171-4e78-b392-d091e0e135eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:37.446323 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ca526-e171-4e78-b392-d091e0e135eb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:37.446596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ca526-e171-4e78-b392-d091e0e135eb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:37.446859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ca526-e171-4e78-b392-d091e0e135eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:37.454639 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbde608-5948-4bcc-8e1b-007f9d69d134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:37.455472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbde608-5948-4bcc-8e1b-007f9d69d134 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:37.455842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbde608-5948-4bcc-8e1b-007f9d69d134 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:37.456203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbde608-5948-4bcc-8e1b-007f9d69d134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:37.498906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:37.519269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ca526-e171-4e78-b392-d091e0e135eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:37.520867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ca526-e171-4e78-b392-d091e0e135eb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:37.525882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbde608-5948-4bcc-8e1b-007f9d69d134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:37.527439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbde608-5948-4bcc-8e1b-007f9d69d134 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:37.571113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:37.624755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 330/644] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:37.625630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ca526-e171-4e78-b392-d091e0e135eb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:37.633532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 315/645] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:37.635166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbde608-5948-4bcc-8e1b-007f9d69d134 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:37.712129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:37.730915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ca526-e171-4e78-b392-d091e0e135eb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:37.740804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbde608-5948-4bcc-8e1b-007f9d69d134 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:37.765084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c273944-516f-4db5-b415-70bbef05f02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:37.765628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c273944-516f-4db5-b415-70bbef05f02a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:37.765899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c273944-516f-4db5-b415-70bbef05f02a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:37.766149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c273944-516f-4db5-b415-70bbef05f02a None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:37.766800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c273944-516f-4db5-b415-70bbef05f02a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:37.767089 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c273944-516f-4db5-b415-70bbef05f02a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:37.768487 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c273944-516f-4db5-b415-70bbef05f02a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:37.778219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2656de-670a-4298-9065-008b4fc6767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:37.779043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2656de-670a-4298-9065-008b4fc6767e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:37.779493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2656de-670a-4298-9065-008b4fc6767e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:37.784004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 331/646] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:37.784004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c273944-516f-4db5-b415-70bbef05f02a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:37.784565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2656de-670a-4298-9065-008b4fc6767e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:37.797110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2656de-670a-4298-9065-008b4fc6767e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-dd2656de-670a-4298-9065-008b4fc6767e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:37.802253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:37.803174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:37.804189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 316/647] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:37.804948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2656de-670a-4298-9065-008b4fc6767e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:37.810253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:37.897078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c273944-516f-4db5-b415-70bbef05f02a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:37.913357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2656de-670a-4298-9065-008b4fc6767e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:37.932906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcaada-40b7-4c15-aa11-a5be9635dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:37.933539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcaada-40b7-4c15-aa11-a5be9635dd97 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:37.933810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcaada-40b7-4c15-aa11-a5be9635dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:37.934074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcaada-40b7-4c15-aa11-a5be9635dd97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:37.946783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcaada-40b7-4c15-aa11-a5be9635dd97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:37.948272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcaada-40b7-4c15-aa11-a5be9635dd97 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:37.950145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:37.951655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfabeb6-0c12-4e08-90e1-f13c2fbc55b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:37.952461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfabeb6-0c12-4e08-90e1-f13c2fbc55b8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:37.952869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfabeb6-0c12-4e08-90e1-f13c2fbc55b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:37.953218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfabeb6-0c12-4e08-90e1-f13c2fbc55b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-cddcaada-40b7-4c15-aa11-a5be9635dd97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:37.963786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:37.964747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:37.965634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:37.965634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:37.965634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:37.965805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfabeb6-0c12-4e08-90e1-f13c2fbc55b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:37.965886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 332/648] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:37.966474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcaada-40b7-4c15-aa11-a5be9635dd97 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:37.970560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfabeb6-0c12-4e08-90e1-f13c2fbc55b8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1cfabeb6-0c12-4e08-90e1-f13c2fbc55b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:37.986430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:37.987621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:37.988506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:37.988506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:37.988506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:37.988506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 317/649] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:37.988506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfabeb6-0c12-4e08-90e1-f13c2fbc55b8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.041957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:38.064997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcaada-40b7-4c15-aa11-a5be9635dd97 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:38.085627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfabeb6-0c12-4e08-90e1-f13c2fbc55b8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:38.097473 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4bad0-dc86-4299-8006-142917c6369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:38.098105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bad0-dc86-4299-8006-142917c6369e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.098377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bad0-dc86-4299-8006-142917c6369e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.098651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bad0-dc86-4299-8006-142917c6369e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.105932 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4bad0-dc86-4299-8006-142917c6369e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:38.107392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4bad0-dc86-4299-8006-142917c6369e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:38.118314 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983ee8b-3a72-408c-bcb6-331d2d6501f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-87f4bad0-dc86-4299-8006-142917c6369e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:38.118639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:38.119727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:38.121027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:38.121027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:38.121027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:38.121027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:38.121027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:38.121027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:38.121027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:38.121027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:38.121027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 04:19:38.121027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:38.121574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ee8b-3a72-408c-bcb6-331d2d6501f9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.121574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ee8b-3a72-408c-bcb6-331d2d6501f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.121574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ee8b-3a72-408c-bcb6-331d2d6501f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.121775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 333/650] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:38.121843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983ee8b-3a72-408c-bcb6-331d2d6501f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:38.121843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983ee8b-3a72-408c-bcb6-331d2d6501f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:38.121971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4bad0-dc86-4299-8006-142917c6369e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.122041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983ee8b-3a72-408c-bcb6-331d2d6501f9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:38.129965 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 318/651] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:38.131166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2e93-e7f0-403b-a52b-1d2e18659c1e None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.131480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2e93-e7f0-403b-a52b-1d2e18659c1e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.131743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2e93-e7f0-403b-a52b-1d2e18659c1e None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.133074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 319/652] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:38.133564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e2e93-e7f0-403b-a52b-1d2e18659c1e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.176525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:38.220537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4bad0-dc86-4299-8006-142917c6369e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:38.236422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e2e93-e7f0-403b-a52b-1d2e18659c1e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:38.252335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:38.253283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252367-c828-45b0-9bf2-7e0ec51b2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:38.253944 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252367-c828-45b0-9bf2-7e0ec51b2188 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.254212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252367-c828-45b0-9bf2-7e0ec51b2188 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.254537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252367-c828-45b0-9bf2-7e0ec51b2188 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.255184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14252367-c828-45b0-9bf2-7e0ec51b2188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:38.255533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14252367-c828-45b0-9bf2-7e0ec51b2188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:38.256901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14252367-c828-45b0-9bf2-7e0ec51b2188 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:38.268349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 334/653] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:38.269160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252367-c828-45b0-9bf2-7e0ec51b2188 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.272758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b72ed1-d6cb-469c-a33c-0f56d9de022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:38.273367 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b72ed1-d6cb-469c-a33c-0f56d9de022d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.273637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b72ed1-d6cb-469c-a33c-0f56d9de022d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.273902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b72ed1-d6cb-469c-a33c-0f56d9de022d None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.274543 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b72ed1-d6cb-469c-a33c-0f56d9de022d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:38.274840 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b72ed1-d6cb-469c-a33c-0f56d9de022d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:38.276238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b72ed1-d6cb-469c-a33c-0f56d9de022d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:38.288256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 320/654] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:38.289473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f14212-2d6c-49ea-ad80-4961b74fe5da None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.289751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f14212-2d6c-49ea-ad80-4961b74fe5da None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.290017 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f14212-2d6c-49ea-ad80-4961b74fe5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.308203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d1f14212-2d6c-49ea-ad80-4961b74fe5da None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:38.309313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d1f14212-2d6c-49ea-ad80-4961b74fe5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:38.374930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252367-c828-45b0-9bf2-7e0ec51b2188 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:38.377519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 321/655] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:38.378150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f14212-2d6c-49ea-ad80-4961b74fe5da None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.390860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:38.412646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17dfb0-4030-4fb9-8776-556fdd798696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:38.413254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17dfb0-4030-4fb9-8776-556fdd798696 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.413618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17dfb0-4030-4fb9-8776-556fdd798696 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.413893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17dfb0-4030-4fb9-8776-556fdd798696 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17dfb0-4030-4fb9-8776-556fdd798696 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:38.415343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17dfb0-4030-4fb9-8776-556fdd798696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:38.416390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17dfb0-4030-4fb9-8776-556fdd798696 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:38.440345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 335/656] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Oct 6 04:19:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:38.441446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17dfb0-4030-4fb9-8776-556fdd798696 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.480560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f14212-2d6c-49ea-ad80-4961b74fe5da None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:38.488485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:38.518445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159968-2ed8-481d-89b1-cd7226eee0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:38.519082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159968-2ed8-481d-89b1-cd7226eee0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.519376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159968-2ed8-481d-89b1-cd7226eee0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.519651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159968-2ed8-481d-89b1-cd7226eee0b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.529637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31159968-2ed8-481d-89b1-cd7226eee0b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:38.531171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31159968-2ed8-481d-89b1-cd7226eee0b5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:38.545569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17dfb0-4030-4fb9-8776-556fdd798696 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-31159968-2ed8-481d-89b1-cd7226eee0b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:38.545836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:38.547135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:38.548100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:38.548100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:38.548100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:38.552327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 322/657] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:38.552962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159968-2ed8-481d-89b1-cd7226eee0b5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.582033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a31a7-4e3d-418a-beb6-d910e2fcb149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:38.582587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a31a7-4e3d-418a-beb6-d910e2fcb149 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.582953 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a31a7-4e3d-418a-beb6-d910e2fcb149 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.583222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a31a7-4e3d-418a-beb6-d910e2fcb149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.590133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a31a7-4e3d-418a-beb6-d910e2fcb149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:38.592341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a31a7-4e3d-418a-beb6-d910e2fcb149 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-503a31a7-4e3d-418a-beb6-d910e2fcb149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:38.604768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:38.605702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:38.606599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:38.606599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:38.606599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:38.606599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:38.606599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:38.606599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:38.606599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:38.606599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:38.606599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 336/658] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:38.606599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a31a7-4e3d-418a-beb6-d910e2fcb149 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.639159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:38.663820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159968-2ed8-481d-89b1-cd7226eee0b5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:38.697772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d19c0-34ea-4872-a21f-b9778071a29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:38.698406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d19c0-34ea-4872-a21f-b9778071a29d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.698685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d19c0-34ea-4872-a21f-b9778071a29d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.698978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d19c0-34ea-4872-a21f-b9778071a29d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.706218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d19c0-34ea-4872-a21f-b9778071a29d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:38.707709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d19c0-34ea-4872-a21f-b9778071a29d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:38.710110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a31a7-4e3d-418a-beb6-d910e2fcb149 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-155d19c0-34ea-4872-a21f-b9778071a29d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:38.719238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:38.720177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:38.721224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:38.721224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:38.721224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:38.721224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:38.721224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:38.721224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:38.721224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:38.721224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:38.721224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 323/659] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:38.721224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d19c0-34ea-4872-a21f-b9778071a29d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.742717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:38.747918 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503994b-f76e-4084-9576-24db55a3d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:38.748536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503994b-f76e-4084-9576-24db55a3d635 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.748810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503994b-f76e-4084-9576-24db55a3d635 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.749080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503994b-f76e-4084-9576-24db55a3d635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.818042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503994b-f76e-4084-9576-24db55a3d635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:38.819559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503994b-f76e-4084-9576-24db55a3d635 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:38.823995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d19c0-34ea-4872-a21f-b9778071a29d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:38.850219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:38.856902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e27d3a-e6eb-45ea-9a37-017fdde2daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:38.857506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27d3a-e6eb-45ea-9a37-017fdde2daaa None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:38.857783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27d3a-e6eb-45ea-9a37-017fdde2daaa None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:38.858054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27d3a-e6eb-45ea-9a37-017fdde2daaa None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:38.858714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e27d3a-e6eb-45ea-9a37-017fdde2daaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:38.859013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e27d3a-e6eb-45ea-9a37-017fdde2daaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:38.860417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e27d3a-e6eb-45ea-9a37-017fdde2daaa None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:38.872172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 324/660] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:38.872953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e27d3a-e6eb-45ea-9a37-017fdde2daaa None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.926217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 337/661] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:38.926217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503994b-f76e-4084-9576-24db55a3d635 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:38.955354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:38.978366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e27d3a-e6eb-45ea-9a37-017fdde2daaa None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.010860 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ced83-635d-4b8c-b022-cc56837ea7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.011490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ced83-635d-4b8c-b022-cc56837ea7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.011767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ced83-635d-4b8c-b022-cc56837ea7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.012029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ced83-635d-4b8c-b022-cc56837ea7f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.012714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ced83-635d-4b8c-b022-cc56837ea7f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:39.013016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ced83-635d-4b8c-b022-cc56837ea7f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:39.014490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ced83-635d-4b8c-b022-cc56837ea7f5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:39.019251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503994b-f76e-4084-9576-24db55a3d635 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.025772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 325/662] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:39.026581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ced83-635d-4b8c-b022-cc56837ea7f5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.049597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:39.054942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b16025-c16d-46df-88f1-50abec823f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.055608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b16025-c16d-46df-88f1-50abec823f06 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.055884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b16025-c16d-46df-88f1-50abec823f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.056149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b16025-c16d-46df-88f1-50abec823f06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.067270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b16025-c16d-46df-88f1-50abec823f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-97b16025-c16d-46df-88f1-50abec823f06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:39.072056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:39.075396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 338/663] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:39.076553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b16025-c16d-46df-88f1-50abec823f06 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.133107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ced83-635d-4b8c-b022-cc56837ea7f5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.165970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141f8d-d0f5-4716-a1db-f564b6e2a2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.166574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141f8d-d0f5-4716-a1db-f564b6e2a2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.166846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141f8d-d0f5-4716-a1db-f564b6e2a2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.167110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141f8d-d0f5-4716-a1db-f564b6e2a2b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.167814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141f8d-d0f5-4716-a1db-f564b6e2a2b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:39.168115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141f8d-d0f5-4716-a1db-f564b6e2a2b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:39.169548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141f8d-d0f5-4716-a1db-f564b6e2a2b4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:39.175401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b16025-c16d-46df-88f1-50abec823f06 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.176548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:39.187009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 326/664] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:39.187009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141f8d-d0f5-4716-a1db-f564b6e2a2b4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.216921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc76b87-5102-4368-b5b5-3e9d67493d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.217573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc76b87-5102-4368-b5b5-3e9d67493d5c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.217841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc76b87-5102-4368-b5b5-3e9d67493d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.218555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc76b87-5102-4368-b5b5-3e9d67493d5c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.225437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc76b87-5102-4368-b5b5-3e9d67493d5c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:39.226865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc76b87-5102-4368-b5b5-3e9d67493d5c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4fc76b87-5102-4368-b5b5-3e9d67493d5c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:39.238256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:39.239216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:39.240226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 339/665] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:39.240843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc76b87-5102-4368-b5b5-3e9d67493d5c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.281707 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141f8d-d0f5-4716-a1db-f564b6e2a2b4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.293457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:39.315339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2ba1-d517-4501-a0d0-0ebaae1079f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.316757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2ba1-d517-4501-a0d0-0ebaae1079f2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.317165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2ba1-d517-4501-a0d0-0ebaae1079f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.317431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2ba1-d517-4501-a0d0-0ebaae1079f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.327774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2ba1-d517-4501-a0d0-0ebaae1079f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:39.329339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2ba1-d517-4501-a0d0-0ebaae1079f2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:39.339928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc76b87-5102-4368-b5b5-3e9d67493d5c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b63a2ba1-d517-4501-a0d0-0ebaae1079f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:39.344249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:39.345346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:39.346228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:39.346228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:39.346228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:39.346228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 327/666] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:39.346228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2ba1-d517-4501-a0d0-0ebaae1079f2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.378517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0c6eb-213f-4f1c-af90-238154036540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.379125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c6eb-213f-4f1c-af90-238154036540 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.379434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c6eb-213f-4f1c-af90-238154036540 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.379704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c6eb-213f-4f1c-af90-238154036540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.380440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0c6eb-213f-4f1c-af90-238154036540 None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=457880195ed849d2b594ddea6acdf7df) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:39.381022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0c6eb-213f-4f1c-af90-238154036540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:39.382474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0c6eb-213f-4f1c-af90-238154036540 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:39.399456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 340/667] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/role_assignments?user.id=457880195ed849d2b594ddea6acdf7df&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:39.399456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0c6eb-213f-4f1c-af90-238154036540 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.399938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:39.450282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2ba1-d517-4501-a0d0-0ebaae1079f2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.488018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc10ae-3115-4ed5-8930-a5143b19b4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.488679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc10ae-3115-4ed5-8930-a5143b19b4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.488954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc10ae-3115-4ed5-8930-a5143b19b4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.489223 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc10ae-3115-4ed5-8930-a5143b19b4a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.490023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc10ae-3115-4ed5-8930-a5143b19b4a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:39.490324 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc10ae-3115-4ed5-8930-a5143b19b4a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:39.492227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc10ae-3115-4ed5-8930-a5143b19b4a8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:39.502198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 328/668] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:39.502868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc10ae-3115-4ed5-8930-a5143b19b4a8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.515300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0c6eb-213f-4f1c-af90-238154036540 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.533346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:39.553174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc7fd7-e70d-4158-9971-7e7466fff645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.553803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc7fd7-e70d-4158-9971-7e7466fff645 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.554077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc7fd7-e70d-4158-9971-7e7466fff645 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.554346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc7fd7-e70d-4158-9971-7e7466fff645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.555087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc7fd7-e70d-4158-9971-7e7466fff645 None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=0481d4c0be0b46189e339d1e00bee4c0) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:39.555423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc7fd7-e70d-4158-9971-7e7466fff645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:39.556885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc7fd7-e70d-4158-9971-7e7466fff645 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:39.563776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 341/669] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/role_assignments?user.id=0481d4c0be0b46189e339d1e00bee4c0&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:39.564608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc7fd7-e70d-4158-9971-7e7466fff645 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.619921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc10ae-3115-4ed5-8930-a5143b19b4a8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.639353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:39.668356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21de80-0125-488a-b8e2-f359de8ec303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.671289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21de80-0125-488a-b8e2-f359de8ec303 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.671289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21de80-0125-488a-b8e2-f359de8ec303 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.671289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21de80-0125-488a-b8e2-f359de8ec303 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.671289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21de80-0125-488a-b8e2-f359de8ec303 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:39.671289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21de80-0125-488a-b8e2-f359de8ec303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:39.672716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21de80-0125-488a-b8e2-f359de8ec303 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:39.694675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 329/670] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:39.695413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21de80-0125-488a-b8e2-f359de8ec303 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.696026 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc7fd7-e70d-4158-9971-7e7466fff645 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.746786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e4294-47fb-4a16-89a9-22200f119443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.747808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e4294-47fb-4a16-89a9-22200f119443 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.747808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e4294-47fb-4a16-89a9-22200f119443 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.747978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e4294-47fb-4a16-89a9-22200f119443 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.748577 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e4294-47fb-4a16-89a9-22200f119443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:39.748871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e4294-47fb-4a16-89a9-22200f119443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:39.750317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e4294-47fb-4a16-89a9-22200f119443 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:39.766555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 342/671] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:39.767908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e4294-47fb-4a16-89a9-22200f119443 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.822052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:39.835376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21de80-0125-488a-b8e2-f359de8ec303 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.878880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f904406-c0fd-4a64-8670-a3c7486ab594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.879677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904406-c0fd-4a64-8670-a3c7486ab594 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.879961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904406-c0fd-4a64-8670-a3c7486ab594 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.880116 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904406-c0fd-4a64-8670-a3c7486ab594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.893665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f904406-c0fd-4a64-8670-a3c7486ab594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:39.895296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f904406-c0fd-4a64-8670-a3c7486ab594 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:39.907352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e4294-47fb-4a16-89a9-22200f119443 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-3f904406-c0fd-4a64-8670-a3c7486ab594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:39.915686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:39.916839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:39.918008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:39.918008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:39.918008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:39.919812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 330/672] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:39.920815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f904406-c0fd-4a64-8670-a3c7486ab594 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:39.943899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebca95e-d247-490a-a1ec-c263838101ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:39.944529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebca95e-d247-490a-a1ec-c263838101ef None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:39.944805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebca95e-d247-490a-a1ec-c263838101ef None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:39.945076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebca95e-d247-490a-a1ec-c263838101ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:39.959677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:40.020244 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebca95e-d247-490a-a1ec-c263838101ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:40.021704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebca95e-d247-490a-a1ec-c263838101ef None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:40.046885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f904406-c0fd-4a64-8670-a3c7486ab594 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:40.067281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:40.088187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46be60-fa22-40ba-bb2e-ede6abad72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:40.088966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46be60-fa22-40ba-bb2e-ede6abad72a0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:40.089354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46be60-fa22-40ba-bb2e-ede6abad72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:40.089638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46be60-fa22-40ba-bb2e-ede6abad72a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:40.098898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46be60-fa22-40ba-bb2e-ede6abad72a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:40.101581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46be60-fa22-40ba-bb2e-ede6abad72a0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-8e46be60-fa22-40ba-bb2e-ede6abad72a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:40.117308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:40.118260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:40.119159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:40.119159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:40.119159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:40.119159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:40.119159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:40.119159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:40.119159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:40.119159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:40.119159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 331/673] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:40.119720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46be60-fa22-40ba-bb2e-ede6abad72a0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:40.142170 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 343/674] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:40.143582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebca95e-d247-490a-a1ec-c263838101ef None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:40.228087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:40.251422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46be60-fa22-40ba-bb2e-ede6abad72a0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:40.262144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebca95e-d247-490a-a1ec-c263838101ef None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:40.290234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41887da-f2af-43f2-b1ca-e10ccecbe8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:40.290853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41887da-f2af-43f2-b1ca-e10ccecbe8fe None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:40.291126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41887da-f2af-43f2-b1ca-e10ccecbe8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:40.291443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41887da-f2af-43f2-b1ca-e10ccecbe8fe None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:40.292352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41887da-f2af-43f2-b1ca-e10ccecbe8fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:40.292653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41887da-f2af-43f2-b1ca-e10ccecbe8fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:40.294714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41887da-f2af-43f2-b1ca-e10ccecbe8fe None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:40.308679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfecd21-f1f7-4e56-97e4-9f53fee4b0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:40.314000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 332/675] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:40.314000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41887da-f2af-43f2-b1ca-e10ccecbe8fe None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:40.317510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfecd21-f1f7-4e56-97e4-9f53fee4b0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:40.318037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfecd21-f1f7-4e56-97e4-9f53fee4b0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:40.318508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfecd21-f1f7-4e56-97e4-9f53fee4b0e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:40.320095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfecd21-f1f7-4e56-97e4-9f53fee4b0e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:40.320618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfecd21-f1f7-4e56-97e4-9f53fee4b0e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:40.322774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfecd21-f1f7-4e56-97e4-9f53fee4b0e2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:40.334044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:40.343097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 344/676] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:40.344781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfecd21-f1f7-4e56-97e4-9f53fee4b0e2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:40.430319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41887da-f2af-43f2-b1ca-e10ccecbe8fe None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:40.468996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572063-123b-4e6d-a848-b7b466d23677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:40.470056 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572063-123b-4e6d-a848-b7b466d23677 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:40.470237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfecd21-f1f7-4e56-97e4-9f53fee4b0e2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:40.470733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572063-123b-4e6d-a848-b7b466d23677 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:40.471196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572063-123b-4e6d-a848-b7b466d23677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:40.483224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a572063-123b-4e6d-a848-b7b466d23677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:40.485233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a572063-123b-4e6d-a848-b7b466d23677 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:40.487719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-8a572063-123b-4e6d-a848-b7b466d23677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:40.507784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:40.508819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:40.509729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:40.509729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:40.509729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:40.515605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 333/677] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:40.516322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032cd56-61ae-4eed-86fe-f0731244fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:40.516903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032cd56-61ae-4eed-86fe-f0731244fb0b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:40.517178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032cd56-61ae-4eed-86fe-f0731244fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:40.517442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032cd56-61ae-4eed-86fe-f0731244fb0b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:40.518209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572063-123b-4e6d-a848-b7b466d23677 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:40.526752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032cd56-61ae-4eed-86fe-f0731244fb0b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:40.528416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032cd56-61ae-4eed-86fe-f0731244fb0b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3032cd56-61ae-4eed-86fe-f0731244fb0b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:40.541046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:40.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:40.542973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:40.542973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:40.542973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:40.542973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:40.542973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:40.542973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:40.542973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:40.542973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:40.542973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:40.542973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:40.547217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 345/678] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:40.548180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032cd56-61ae-4eed-86fe-f0731244fb0b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:40.632459 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:40.642011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572063-123b-4e6d-a848-b7b466d23677 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:40.682421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444968db-3037-4762-9e11-792bd56d3a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:40.683044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444968db-3037-4762-9e11-792bd56d3a17 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:40.683340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444968db-3037-4762-9e11-792bd56d3a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:40.683650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444968db-3037-4762-9e11-792bd56d3a17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:40.684629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444968db-3037-4762-9e11-792bd56d3a17 None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=e66a78c94f03443cbae595bba07e458d) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:40.684931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444968db-3037-4762-9e11-792bd56d3a17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:40.686312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032cd56-61ae-4eed-86fe-f0731244fb0b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:40.686450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444968db-3037-4762-9e11-792bd56d3a17 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:40.695467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 334/679] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:40 2022] GET /identity/v3/role_assignments?user.id=e66a78c94f03443cbae595bba07e458d&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:40.696600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444968db-3037-4762-9e11-792bd56d3a17 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:40.751524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341033a-51e1-4629-9381-f35d30b727b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:40.753715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341033a-51e1-4629-9381-f35d30b727b9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:40.754397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341033a-51e1-4629-9381-f35d30b727b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:40.755543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341033a-51e1-4629-9381-f35d30b727b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:40.756407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341033a-51e1-4629-9381-f35d30b727b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:40.757107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341033a-51e1-4629-9381-f35d30b727b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:40.759684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341033a-51e1-4629-9381-f35d30b727b9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:40.786133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 346/680] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:40.794487 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341033a-51e1-4629-9381-f35d30b727b9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:40.834603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:40.935943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444968db-3037-4762-9e11-792bd56d3a17 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:40.941633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341033a-51e1-4629-9381-f35d30b727b9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:40.970269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:40.977514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e59d-6d2c-43b5-ae29-b247fcaeaa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:40.978136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e59d-6d2c-43b5-ae29-b247fcaeaa37 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:40.978410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e59d-6d2c-43b5-ae29-b247fcaeaa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:40.978747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e59d-6d2c-43b5-ae29-b247fcaeaa37 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:40.979428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1e59d-6d2c-43b5-ae29-b247fcaeaa37 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:40.979736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1e59d-6d2c-43b5-ae29-b247fcaeaa37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:40.981205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1e59d-6d2c-43b5-ae29-b247fcaeaa37 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:40.991794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b7ba-6eca-42fc-bbc1-c619a53083b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:40.992769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b7ba-6eca-42fc-bbc1-c619a53083b8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:40.993323 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b7ba-6eca-42fc-bbc1-c619a53083b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:40.993848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b7ba-6eca-42fc-bbc1-c619a53083b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:41.001516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b7ba-6eca-42fc-bbc1-c619a53083b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:41.003327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b7ba-6eca-42fc-bbc1-c619a53083b8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:41.003437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 335/681] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 6 04:19:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:41.009579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e59d-6d2c-43b5-ae29-b247fcaeaa37 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-cc11b7ba-6eca-42fc-bbc1-c619a53083b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:41.017287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:41.018202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:41.019102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:41.019102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:41.019102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:41.019102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:41.019102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:41.019102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:41.019102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:41.019102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:41.021904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 347/682] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:41.028576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b7ba-6eca-42fc-bbc1-c619a53083b8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:41.124685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e59d-6d2c-43b5-ae29-b247fcaeaa37 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:41.142981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b7ba-6eca-42fc-bbc1-c619a53083b8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:41.144289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:41.166006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e13c05-577b-4741-9c3f-e4d9c2fb8aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:41.166860 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e13c05-577b-4741-9c3f-e4d9c2fb8aeb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:41.166974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e13c05-577b-4741-9c3f-e4d9c2fb8aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:41.167139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e13c05-577b-4741-9c3f-e4d9c2fb8aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:41.182898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39976f4f-7cae-4a02-b3ce-ff3c9da069a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:41.184031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39976f4f-7cae-4a02-b3ce-ff3c9da069a2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:41.184280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39976f4f-7cae-4a02-b3ce-ff3c9da069a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:41.184572 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39976f4f-7cae-4a02-b3ce-ff3c9da069a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:41.185270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39976f4f-7cae-4a02-b3ce-ff3c9da069a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:41.185570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39976f4f-7cae-4a02-b3ce-ff3c9da069a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:41.187148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39976f4f-7cae-4a02-b3ce-ff3c9da069a2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:41.207389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 348/683] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:41.214444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39976f4f-7cae-4a02-b3ce-ff3c9da069a2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:41.259434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e13c05-577b-4741-9c3f-e4d9c2fb8aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:41.261737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e13c05-577b-4741-9c3f-e4d9c2fb8aeb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:41.300362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:41.384976 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 336/684] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:41.396595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e13c05-577b-4741-9c3f-e4d9c2fb8aeb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:41.412657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39976f4f-7cae-4a02-b3ce-ff3c9da069a2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:41.426566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:41.449233 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe95b-5601-4494-b982-ca1443a507eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:41.450089 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe95b-5601-4494-b982-ca1443a507eb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:41.450440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe95b-5601-4494-b982-ca1443a507eb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:41.450748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe95b-5601-4494-b982-ca1443a507eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:41.451614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfe95b-5601-4494-b982-ca1443a507eb None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=39ca0a824c4740dbb911bb1a38cfc47b) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:41.452046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfe95b-5601-4494-b982-ca1443a507eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:41.459454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfe95b-5601-4494-b982-ca1443a507eb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:41.461287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 349/685] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:41 2022] GET /identity/v3/role_assignments?user.id=39ca0a824c4740dbb911bb1a38cfc47b&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:41.532099 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e13c05-577b-4741-9c3f-e4d9c2fb8aeb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:41.586715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae3a34-4da7-4980-8536-e1eb18fc56a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:41.587711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae3a34-4da7-4980-8536-e1eb18fc56a2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:41.588158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae3a34-4da7-4980-8536-e1eb18fc56a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:41.588574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae3a34-4da7-4980-8536-e1eb18fc56a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:41.600893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae3a34-4da7-4980-8536-e1eb18fc56a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:41.609190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae3a34-4da7-4980-8536-e1eb18fc56a2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f4ae3a34-4da7-4980-8536-e1eb18fc56a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:41.627012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:41.628289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:41.629395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:41.629395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:41.629395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:41.631255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 337/686] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:41.636764 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe95b-5601-4494-b982-ca1443a507eb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:41.776193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe95b-5601-4494-b982-ca1443a507eb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:41.778528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:41.811415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b63b4-8ddb-467b-8af4-e9b8c40f8740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:41.812034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b63b4-8ddb-467b-8af4-e9b8c40f8740 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:41.812301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b63b4-8ddb-467b-8af4-e9b8c40f8740 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:41.812562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b63b4-8ddb-467b-8af4-e9b8c40f8740 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:41.813204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b63b4-8ddb-467b-8af4-e9b8c40f8740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:41.813497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b63b4-8ddb-467b-8af4-e9b8c40f8740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:41.814967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b63b4-8ddb-467b-8af4-e9b8c40f8740 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:41.827548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 350/687] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:41.832865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae3a34-4da7-4980-8536-e1eb18fc56a2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:41.883734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cab8a-ca92-4442-881a-af5320ffc5a0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:41.884014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cab8a-ca92-4442-881a-af5320ffc5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:41.884281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cab8a-ca92-4442-881a-af5320ffc5a0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:41.889787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 351/688] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:41.893082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761762be-76cd-4d04-b81a-2d72b4e63d6f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:41.893359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761762be-76cd-4d04-b81a-2d72b4e63d6f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:41.893627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761762be-76cd-4d04-b81a-2d72b4e63d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:41.928676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-761762be-76cd-4d04-b81a-2d72b4e63d6f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:41.929884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-761762be-76cd-4d04-b81a-2d72b4e63d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:41.980045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:42.040354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae3a34-4da7-4980-8536-e1eb18fc56a2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:42.095936 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 352/689] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:42.114834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236b3d-b1ee-4843-bd7b-60ce855fabe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:42.115493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236b3d-b1ee-4843-bd7b-60ce855fabe5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:42.115767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236b3d-b1ee-4843-bd7b-60ce855fabe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:42.116030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236b3d-b1ee-4843-bd7b-60ce855fabe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:42.125823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0236b3d-b1ee-4843-bd7b-60ce855fabe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:42.127375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0236b3d-b1ee-4843-bd7b-60ce855fabe5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-e0236b3d-b1ee-4843-bd7b-60ce855fabe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:42.142577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:42.143532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:42.144447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:42.144447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:42.144447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:42.144447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:42.144447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:42.144447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:42.144447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:42.144447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:42.152156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 338/690] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:42.162266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761762be-76cd-4d04-b81a-2d72b4e63d6f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:42.280922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b57310-4726-4520-ba7c-144aba3cc7f0 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:42.281276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b57310-4726-4520-ba7c-144aba3cc7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:42.281571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b57310-4726-4520-ba7c-144aba3cc7f0 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:42.282777 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 339/691] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:42.289180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fd297-8510-4b4d-bde2-3c0f6fa06fd5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:42.289450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fd297-8510-4b4d-bde2-3c0f6fa06fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:42.289714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fd297-8510-4b4d-bde2-3c0f6fa06fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:42.330431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:42.350767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761762be-76cd-4d04-b81a-2d72b4e63d6f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:42.352353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-836fd297-8510-4b4d-bde2-3c0f6fa06fd5 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:42.353552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-836fd297-8510-4b4d-bde2-3c0f6fa06fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:42.445103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbcb8a-68ce-43eb-8098-f0614b9652e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:42.445103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbcb8a-68ce-43eb-8098-f0614b9652e5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:42.445103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbcb8a-68ce-43eb-8098-f0614b9652e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:42.445103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbcb8a-68ce-43eb-8098-f0614b9652e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:42.445902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbcb8a-68ce-43eb-8098-f0614b9652e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:42.445902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbcb8a-68ce-43eb-8098-f0614b9652e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:42.445902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbcb8a-68ce-43eb-8098-f0614b9652e5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:42.459484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 353/692] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:42.473578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbcb8a-68ce-43eb-8098-f0614b9652e5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:42.542068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 340/693] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:42.566417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fd297-8510-4b4d-bde2-3c0f6fa06fd5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:42.649171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbcb8a-68ce-43eb-8098-f0614b9652e5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:42.684386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b2a26-c4b6-4839-b38c-c46ad4d554f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:42.685192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:42.685915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b2a26-c4b6-4839-b38c-c46ad4d554f6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:42.686334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b2a26-c4b6-4839-b38c-c46ad4d554f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:42.686996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b2a26-c4b6-4839-b38c-c46ad4d554f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:42.688000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b2a26-c4b6-4839-b38c-c46ad4d554f6 None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=85602a9d62bc475fb5da609f97958d5f) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:42.688942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b2a26-c4b6-4839-b38c-c46ad4d554f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:42.690642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b2a26-c4b6-4839-b38c-c46ad4d554f6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:42.698036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 354/694] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:42 2022] GET /identity/v3/role_assignments?user.id=85602a9d62bc475fb5da609f97958d5f&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:42.774299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fd297-8510-4b4d-bde2-3c0f6fa06fd5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:42.825414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214502d1-1e36-486b-8137-f5f7845f8c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:42.826072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214502d1-1e36-486b-8137-f5f7845f8c60 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:42.826337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214502d1-1e36-486b-8137-f5f7845f8c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:42.826605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214502d1-1e36-486b-8137-f5f7845f8c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:42.832420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b2a26-c4b6-4839-b38c-c46ad4d554f6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:42.845357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214502d1-1e36-486b-8137-f5f7845f8c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:42.846843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214502d1-1e36-486b-8137-f5f7845f8c60 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:42.862927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-214502d1-1e36-486b-8137-f5f7845f8c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:42.872688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:42.873755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:42.874690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:42.874690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:42.874690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:42.880237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 341/695] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:42.884405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214502d1-1e36-486b-8137-f5f7845f8c60 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:43.006547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b2a26-c4b6-4839-b38c-c46ad4d554f6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:43.031675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214502d1-1e36-486b-8137-f5f7845f8c60 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:43.045709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:43.050441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf969a-bfda-473d-ac69-d644b0b5aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:43.051409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf969a-bfda-473d-ac69-d644b0b5aa45 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:43.051998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf969a-bfda-473d-ac69-d644b0b5aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:43.052481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf969a-bfda-473d-ac69-d644b0b5aa45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:43.066165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf969a-bfda-473d-ac69-d644b0b5aa45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fbbf969a-bfda-473d-ac69-d644b0b5aa45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:43.072399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:43.073337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:43.074161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:43.074794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6ac5-a8e9-4ebd-ba29-f1f696c4ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:43.075399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6ac5-a8e9-4ebd-ba29-f1f696c4ff16 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:43.075399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6ac5-a8e9-4ebd-ba29-f1f696c4ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:43.075552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6ac5-a8e9-4ebd-ba29-f1f696c4ff16 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:43.076178 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da6ac5-a8e9-4ebd-ba29-f1f696c4ff16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:43.076478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da6ac5-a8e9-4ebd-ba29-f1f696c4ff16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:43.082291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da6ac5-a8e9-4ebd-ba29-f1f696c4ff16 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:43.082593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 355/696] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:43.084103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf969a-bfda-473d-ac69-d644b0b5aa45 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:43.093209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 342/697] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:43.100255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6ac5-a8e9-4ebd-ba29-f1f696c4ff16 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:43.176594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:43.204046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf969a-bfda-473d-ac69-d644b0b5aa45 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:43.224610 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6ac5-a8e9-4ebd-ba29-f1f696c4ff16 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:43.247110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e0f27-10ab-42e7-ad50-7778a09d05d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:43.248097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e0f27-10ab-42e7-ad50-7778a09d05d7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:43.248702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e0f27-10ab-42e7-ad50-7778a09d05d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:43.249298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e0f27-10ab-42e7-ad50-7778a09d05d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:43.250158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e0f27-10ab-42e7-ad50-7778a09d05d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:43.250652 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e0f27-10ab-42e7-ad50-7778a09d05d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:43.252551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e0f27-10ab-42e7-ad50-7778a09d05d7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:43.266554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 356/698] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:43.266723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0d552-2f69-4539-863f-2359600e5f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:43.266723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d552-2f69-4539-863f-2359600e5f4e None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:43.266723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d552-2f69-4539-863f-2359600e5f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:43.266723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d552-2f69-4539-863f-2359600e5f4e None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:43.266991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0d552-2f69-4539-863f-2359600e5f4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:43.268570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e0f27-10ab-42e7-ad50-7778a09d05d7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:43.270175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0d552-2f69-4539-863f-2359600e5f4e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:43.300592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 343/699] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:19:43 2022] POST /identity/v3/users => generated 254 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:19:43.400185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e0f27-10ab-42e7-ad50-7778a09d05d7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:43.443817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba16d1d-54b9-43bd-b1a1-fcb62714aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:43.444894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba16d1d-54b9-43bd-b1a1-fcb62714aa9e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:43.445374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba16d1d-54b9-43bd-b1a1-fcb62714aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:43.446307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba16d1d-54b9-43bd-b1a1-fcb62714aa9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:43.461484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:43.465619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba16d1d-54b9-43bd-b1a1-fcb62714aa9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:43.467576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba16d1d-54b9-43bd-b1a1-fcb62714aa9e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-dba16d1d-54b9-43bd-b1a1-fcb62714aa9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:43.490540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:43.492007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:43.492924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:43.492924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:43.492924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:43.496338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 357/700] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:43.501732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0d552-2f69-4539-863f-2359600e5f4e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:43.539107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:43.620890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0d552-2f69-4539-863f-2359600e5f4e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:43.655251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc7afb-7bfc-44d9-afbc-7766b5f3a7e5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:43.655932 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc7afb-7bfc-44d9-afbc-7766b5f3a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:43.656448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc7afb-7bfc-44d9-afbc-7766b5f3a7e5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:43.657994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 358/701] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:19:43.664313 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57fd32-9fbc-45b9-bdd5-142accb5297e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:43.664596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57fd32-9fbc-45b9-bdd5-142accb5297e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:43.664866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57fd32-9fbc-45b9-bdd5-142accb5297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:43.666212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba6618-4cc7-4437-b142-6a238cc900b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:43.667046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6618-4cc7-4437-b142-6a238cc900b0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:43.667603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6618-4cc7-4437-b142-6a238cc900b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:43.668077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6618-4cc7-4437-b142-6a238cc900b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:43.668944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba6618-4cc7-4437-b142-6a238cc900b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:43.669504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba6618-4cc7-4437-b142-6a238cc900b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:43.671344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba6618-4cc7-4437-b142-6a238cc900b0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:43.687441 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 344/702] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:43.688470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fd57fd32-9fbc-45b9-bdd5-142accb5297e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:43.689684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fd57fd32-9fbc-45b9-bdd5-142accb5297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:43.691381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba6618-4cc7-4437-b142-6a238cc900b0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:43.775914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 359/703] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:43.795248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:43.817813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba6618-4cc7-4437-b142-6a238cc900b0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:43.853979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3b383-308b-4f62-854d-6cbea05c535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:43.854609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b383-308b-4f62-854d-6cbea05c535a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:43.854937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b383-308b-4f62-854d-6cbea05c535a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:43.855209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b383-308b-4f62-854d-6cbea05c535a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:43.862558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3b383-308b-4f62-854d-6cbea05c535a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:43.864100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3b383-308b-4f62-854d-6cbea05c535a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-9cd3b383-308b-4f62-854d-6cbea05c535a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:43.882629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:43.883763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:43.885467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 345/704] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 6 04:19:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:43.892323 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57fd32-9fbc-45b9-bdd5-142accb5297e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:44.012250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57fd32-9fbc-45b9-bdd5-142accb5297e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:44.042075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:44.057403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827c497-70ce-4230-8d5a-dd61ed85bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:44.057947 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827c497-70ce-4230-8d5a-dd61ed85bf2e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:44.058220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827c497-70ce-4230-8d5a-dd61ed85bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:44.058487 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827c497-70ce-4230-8d5a-dd61ed85bf2e None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:44.059225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827c497-70ce-4230-8d5a-dd61ed85bf2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:44.059546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827c497-70ce-4230-8d5a-dd61ed85bf2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:44.060978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827c497-70ce-4230-8d5a-dd61ed85bf2e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:44.081601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3b383-308b-4f62-854d-6cbea05c535a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:44.085852 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 360/705] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 6 04:19:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:44.091387 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827c497-70ce-4230-8d5a-dd61ed85bf2e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:44.209431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827c497-70ce-4230-8d5a-dd61ed85bf2e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:44.227685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3b383-308b-4f62-854d-6cbea05c535a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:44.248052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb013e-9b9d-418c-abb1-93ef8fe0e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:44.249119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb013e-9b9d-418c-abb1-93ef8fe0e4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:44.249606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb013e-9b9d-418c-abb1-93ef8fe0e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:44.250151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb013e-9b9d-418c-abb1-93ef8fe0e4a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:44.278956 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a14b9-9b36-4ec8-8338-72b28a115b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:44.280014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a14b9-9b36-4ec8-8338-72b28a115b70 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:44.280523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a14b9-9b36-4ec8-8338-72b28a115b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:44.280969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a14b9-9b36-4ec8-8338-72b28a115b70 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:44.281825 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a14b9-9b36-4ec8-8338-72b28a115b70 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:44.283625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a14b9-9b36-4ec8-8338-72b28a115b70 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-710a14b9-9b36-4ec8-8338-72b28a115b70 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:44.295751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:44.296849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 04:19:44.297718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:44.300686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 346/706] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Oct 6 04:19:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:44.302211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dae89-c445-4ebf-a648-f81f8e0b7024 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:44.302712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dae89-c445-4ebf-a648-f81f8e0b7024 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:44.303190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dae89-c445-4ebf-a648-f81f8e0b7024 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:44.312018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 347/707] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:44.315722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dae89-c445-4ebf-a648-f81f8e0b7024 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:44.320633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:44.330335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:44.350921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb013e-9b9d-418c-abb1-93ef8fe0e4a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:44.353026 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb013e-9b9d-418c-abb1-93ef8fe0e4a3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:44.437542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dae89-c445-4ebf-a648-f81f8e0b7024 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:44.475129 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8a908-5253-471c-b6a3-1ce9d27b0941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:44.476409 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8a908-5253-471c-b6a3-1ce9d27b0941 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:44.476893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8a908-5253-471c-b6a3-1ce9d27b0941 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:44.477374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8a908-5253-471c-b6a3-1ce9d27b0941 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:44.478197 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8a908-5253-471c-b6a3-1ce9d27b0941 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:44.478709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8a908-5253-471c-b6a3-1ce9d27b0941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:44.480379 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8a908-5253-471c-b6a3-1ce9d27b0941 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:44.489002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 361/708] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 04:19:44.489002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6234b8a-6232-4162-8c3b-e33b847caebc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:44.489002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6234b8a-6232-4162-8c3b-e33b847caebc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:44.489002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6234b8a-6232-4162-8c3b-e33b847caebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:44.491577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 348/709] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 6 04:19:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:44.492816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8a908-5253-471c-b6a3-1ce9d27b0941 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:44.509763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e6234b8a-6232-4162-8c3b-e33b847caebc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:44.511297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e6234b8a-6232-4162-8c3b-e33b847caebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:44.585242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:44.598747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 362/710] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:44.598747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6234b8a-6232-4162-8c3b-e33b847caebc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:44.608180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:44.642365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8a908-5253-471c-b6a3-1ce9d27b0941 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:44.716084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6234b8a-6232-4162-8c3b-e33b847caebc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:44.718123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251a17e-4572-4c13-a49e-1ea9a063efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:44.719033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251a17e-4572-4c13-a49e-1ea9a063efa9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:44.719537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251a17e-4572-4c13-a49e-1ea9a063efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:44.720046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251a17e-4572-4c13-a49e-1ea9a063efa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:44.741605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251a17e-4572-4c13-a49e-1ea9a063efa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:44.743473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251a17e-4572-4c13-a49e-1ea9a063efa9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:44.755264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce75182-0abe-4835-b432-b77a79aef6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:44.755907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce75182-0abe-4835-b432-b77a79aef6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:44.756185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce75182-0abe-4835-b432-b77a79aef6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:44.756452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce75182-0abe-4835-b432-b77a79aef6a2 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:44.757089 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce75182-0abe-4835-b432-b77a79aef6a2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:44.757401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce75182-0abe-4835-b432-b77a79aef6a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:44.762649 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce75182-0abe-4835-b432-b77a79aef6a2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:44.766398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 363/711] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 6 04:19:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f251a17e-4572-4c13-a49e-1ea9a063efa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:44.771509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:44.772549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:44.773475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:44.773475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:44.773475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:44.776855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 349/712] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:44.781862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce75182-0abe-4835-b432-b77a79aef6a2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:44.890476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:44.921818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce75182-0abe-4835-b432-b77a79aef6a2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:44.959386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710b9a9-d86c-4a3c-bbc4-fc3bb3c21d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:44.960121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710b9a9-d86c-4a3c-bbc4-fc3bb3c21d89 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:44.960398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710b9a9-d86c-4a3c-bbc4-fc3bb3c21d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:44.960668 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710b9a9-d86c-4a3c-bbc4-fc3bb3c21d89 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:44.961383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710b9a9-d86c-4a3c-bbc4-fc3bb3c21d89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:44.961688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710b9a9-d86c-4a3c-bbc4-fc3bb3c21d89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:44.963097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710b9a9-d86c-4a3c-bbc4-fc3bb3c21d89 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:44.978848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 364/713] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:44.990372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251a17e-4572-4c13-a49e-1ea9a063efa9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:45.072757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710b9a9-d86c-4a3c-bbc4-fc3bb3c21d89 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:45.113320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251a17e-4572-4c13-a49e-1ea9a063efa9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:45.143676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:45.155499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556d04-daae-44d4-9236-cee43c6f217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:45.156549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556d04-daae-44d4-9236-cee43c6f217b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:45.156916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556d04-daae-44d4-9236-cee43c6f217b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:45.157276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556d04-daae-44d4-9236-cee43c6f217b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:45.165481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8556d04-daae-44d4-9236-cee43c6f217b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:45.167661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8556d04-daae-44d4-9236-cee43c6f217b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c8556d04-daae-44d4-9236-cee43c6f217b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:45.179717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:45.180922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:45.182004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:45.182004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:45.182004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:45.182004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:45.182004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:45.182004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:45.182004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:45.182004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:45.183624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 350/714] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:45.188996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556d04-daae-44d4-9236-cee43c6f217b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:45.219647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710b9a9-d86c-4a3c-bbc4-fc3bb3c21d89 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:45.280633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4bfb-2e42-404b-b427-1a65e53db02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:45.282072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4bfb-2e42-404b-b427-1a65e53db02d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:45.282756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4bfb-2e42-404b-b427-1a65e53db02d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:45.283171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4bfb-2e42-404b-b427-1a65e53db02d None admin] PATH_INFO: `/v3/services/network` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:45.284112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f4bfb-2e42-404b-b427-1a65e53db02d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:45.291945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f4bfb-2e42-404b-b427-1a65e53db02d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:45.299855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-583f4bfb-2e42-404b-b427-1a65e53db02d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:45.312643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:45.313687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 04:19:45.314548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:45.319858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 365/715] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:45 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:45.323008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4bfb-2e42-404b-b427-1a65e53db02d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:45.381691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556d04-daae-44d4-9236-cee43c6f217b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:45.429987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19daeac-e949-4a77-abc9-1a5b5ba4e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:45.430567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19daeac-e949-4a77-abc9-1a5b5ba4e057 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:45.430843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19daeac-e949-4a77-abc9-1a5b5ba4e057 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:45.431107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19daeac-e949-4a77-abc9-1a5b5ba4e057 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:45.431819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19daeac-e949-4a77-abc9-1a5b5ba4e057 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:45.432118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19daeac-e949-4a77-abc9-1a5b5ba4e057 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:45.435448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19daeac-e949-4a77-abc9-1a5b5ba4e057 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:45.463906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 351/716] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:45.468575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19daeac-e949-4a77-abc9-1a5b5ba4e057 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:45.505990 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4bfb-2e42-404b-b427-1a65e53db02d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:45.541597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6f23-1da9-4810-88e4-829ddfabc081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:45.542209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6f23-1da9-4810-88e4-829ddfabc081 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:45.542534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6f23-1da9-4810-88e4-829ddfabc081 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:45.542805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6f23-1da9-4810-88e4-829ddfabc081 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:45.543467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d6f23-1da9-4810-88e4-829ddfabc081 None admin] RBAC: Adding query filter params (name=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:45.543766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d6f23-1da9-4810-88e4-829ddfabc081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:45.545159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d6f23-1da9-4810-88e4-829ddfabc081 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:45.554500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 366/717] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:19:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:45.555776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6f23-1da9-4810-88e4-829ddfabc081 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:45.575693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:45.626708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:45.669847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6f23-1da9-4810-88e4-829ddfabc081 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:45.705002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5287c-1d19-45d2-b7eb-6faf4c1ce064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:45.705619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5287c-1d19-45d2-b7eb-6faf4c1ce064 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:45.705955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5287c-1d19-45d2-b7eb-6faf4c1ce064 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:45.706224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5287c-1d19-45d2-b7eb-6faf4c1ce064 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:45.706858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5287c-1d19-45d2-b7eb-6faf4c1ce064 None admin] RBAC: Adding query filter params (type=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:45.707156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5287c-1d19-45d2-b7eb-6faf4c1ce064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:45.708546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5287c-1d19-45d2-b7eb-6faf4c1ce064 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:45.719514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 367/718] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:19:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:45.725450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19daeac-e949-4a77-abc9-1a5b5ba4e057 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:45.786982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9262a-68c8-4162-a609-4628a1ff8bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:45.788043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9262a-68c8-4162-a609-4628a1ff8bdf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:45.788516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9262a-68c8-4162-a609-4628a1ff8bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:45.788978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9262a-68c8-4162-a609-4628a1ff8bdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:45.789948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9262a-68c8-4162-a609-4628a1ff8bdf None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=e6bea894013f40638404395075ade90d, user.id=0481d4c0be0b46189e339d1e00bee4c0) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:45.790465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9262a-68c8-4162-a609-4628a1ff8bdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:45.792200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9262a-68c8-4162-a609-4628a1ff8bdf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:45.801135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df3a87-c814-4f55-b2fe-36da3cc0d28a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:45.801468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df3a87-c814-4f55-b2fe-36da3cc0d28a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:45.801685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df3a87-c814-4f55-b2fe-36da3cc0d28a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:45.803424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 368/719] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:45.804402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 352/720] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:45 2022] GET /identity/v3/role_assignments?user.id=0481d4c0be0b46189e339d1e00bee4c0&scope.project.id=e6bea894013f40638404395075ade90d&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:45.810730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f3fab-1ba8-4335-972d-2a1723d4cf76 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:45.811043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f3fab-1ba8-4335-972d-2a1723d4cf76 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:45.811276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f3fab-1ba8-4335-972d-2a1723d4cf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:45.836582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b52f3fab-1ba8-4335-972d-2a1723d4cf76 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:45.837824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b52f3fab-1ba8-4335-972d-2a1723d4cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:45.941017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 369/721] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:46.016134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72503655-ba87-4bfd-94cd-6d1291548ca2 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:46.016335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72503655-ba87-4bfd-94cd-6d1291548ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:46.016593 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72503655-ba87-4bfd-94cd-6d1291548ca2 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:46.018098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 353/722] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:46.024402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a675d50-5f35-47a8-94d7-9e3e0bd6830a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:46.024689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a675d50-5f35-47a8-94d7-9e3e0bd6830a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:46.024962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a675d50-5f35-47a8-94d7-9e3e0bd6830a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:46.046678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5a675d50-5f35-47a8-94d7-9e3e0bd6830a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:46.047927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5a675d50-5f35-47a8-94d7-9e3e0bd6830a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:46.108142 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:46.126574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 370/723] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:46.295950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72503655-ba87-4bfd-94cd-6d1291548ca2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:46.434773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72503655-ba87-4bfd-94cd-6d1291548ca2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:46.446121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:46.469996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f4854-ee59-4789-a438-c7ec1f70c896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:46.470626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4854-ee59-4789-a438-c7ec1f70c896 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:46.470897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4854-ee59-4789-a438-c7ec1f70c896 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:46.471162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4854-ee59-4789-a438-c7ec1f70c896 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:46.481616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f4854-ee59-4789-a438-c7ec1f70c896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1b7f4854-ee59-4789-a438-c7ec1f70c896 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:46.487342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:46.488285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:46.489126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 354/724] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:46.495023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a675d50-5f35-47a8-94d7-9e3e0bd6830a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:46.506834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f4854-ee59-4789-a438-c7ec1f70c896 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:46.620952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a675d50-5f35-47a8-94d7-9e3e0bd6830a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:46.661061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14446-89b6-40cf-801d-5e8e0bd12e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:46.661682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14446-89b6-40cf-801d-5e8e0bd12e44 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:46.661951 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14446-89b6-40cf-801d-5e8e0bd12e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:46.662210 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14446-89b6-40cf-801d-5e8e0bd12e44 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:46.662880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa14446-89b6-40cf-801d-5e8e0bd12e44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:46.663224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa14446-89b6-40cf-801d-5e8e0bd12e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:46.664675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa14446-89b6-40cf-801d-5e8e0bd12e44 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:46.680638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 371/725] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:46.686336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14446-89b6-40cf-801d-5e8e0bd12e44 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:46.713497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f4854-ee59-4789-a438-c7ec1f70c896 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:46.738945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:46.794354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14446-89b6-40cf-801d-5e8e0bd12e44 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:46.800993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1e078-968f-4dc1-9cca-88e63d7a7571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:46.801643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1e078-968f-4dc1-9cca-88e63d7a7571 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:46.801916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1e078-968f-4dc1-9cca-88e63d7a7571 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:46.802181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1e078-968f-4dc1-9cca-88e63d7a7571 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:46.830319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b397a-241e-423f-8f24-f7c2dee45d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:46.830957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b397a-241e-423f-8f24-f7c2dee45d53 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:46.831232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b397a-241e-423f-8f24-f7c2dee45d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:46.831632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b397a-241e-423f-8f24-f7c2dee45d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:46.836228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1e078-968f-4dc1-9cca-88e63d7a7571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-97d1e078-968f-4dc1-9cca-88e63d7a7571 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:46.841565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:46.842505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:46.843472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:46.844119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b397a-241e-423f-8f24-f7c2dee45d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:46.844675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b397a-241e-423f-8f24-f7c2dee45d53 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:46.851550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 355/726] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:46.852474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1e078-968f-4dc1-9cca-88e63d7a7571 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3d7b397a-241e-423f-8f24-f7c2dee45d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:46.861270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:46.863509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:46.865650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:46.865650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:46.865650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:46.865650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 372/727] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:46.870489 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b397a-241e-423f-8f24-f7c2dee45d53 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:46.909608 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:47.032983 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1e078-968f-4dc1-9cca-88e63d7a7571 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:47.049280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:47.053903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b397a-241e-423f-8f24-f7c2dee45d53 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:47.098883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76682701-9535-4a02-abf2-35c66a98a83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:47.099513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76682701-9535-4a02-abf2-35c66a98a83b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:47.099786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76682701-9535-4a02-abf2-35c66a98a83b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:47.100057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76682701-9535-4a02-abf2-35c66a98a83b None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:47.100732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76682701-9535-4a02-abf2-35c66a98a83b None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:47.101028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76682701-9535-4a02-abf2-35c66a98a83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:47.102647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76682701-9535-4a02-abf2-35c66a98a83b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:47.113442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd3f6a-f52f-4f12-ac18-acae59fa0df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:47.114048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd3f6a-f52f-4f12-ac18-acae59fa0df2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:47.114318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd3f6a-f52f-4f12-ac18-acae59fa0df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:47.114579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd3f6a-f52f-4f12-ac18-acae59fa0df2 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:47.115213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd3f6a-f52f-4f12-ac18-acae59fa0df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:47.115531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd3f6a-f52f-4f12-ac18-acae59fa0df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:47.117172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd3f6a-f52f-4f12-ac18-acae59fa0df2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:47.121618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 356/728] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:47.127806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76682701-9535-4a02-abf2-35c66a98a83b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:47.145830 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 373/729] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:47.151251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd3f6a-f52f-4f12-ac18-acae59fa0df2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:47.276928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:47.292561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76682701-9535-4a02-abf2-35c66a98a83b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:47.315555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd3f6a-f52f-4f12-ac18-acae59fa0df2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:47.355220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c719d3-dd12-4b06-9012-eeaa12ee9a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:47.356101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c719d3-dd12-4b06-9012-eeaa12ee9a0f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:47.356380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c719d3-dd12-4b06-9012-eeaa12ee9a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:47.356650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c719d3-dd12-4b06-9012-eeaa12ee9a0f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:47.365807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c719d3-dd12-4b06-9012-eeaa12ee9a0f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:47.367862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c719d3-dd12-4b06-9012-eeaa12ee9a0f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b2c719d3-dd12-4b06-9012-eeaa12ee9a0f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:47.380526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:47.381523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:47.383227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 374/730] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:47.383872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5c97-3f3b-4f79-b627-217600d5b782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:47.384613 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5c97-3f3b-4f79-b627-217600d5b782 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:47.385089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5c97-3f3b-4f79-b627-217600d5b782 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:47.385928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5c97-3f3b-4f79-b627-217600d5b782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:47.387080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c719d3-dd12-4b06-9012-eeaa12ee9a0f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:47.410334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda5c97-3f3b-4f79-b627-217600d5b782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:47.411852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda5c97-3f3b-4f79-b627-217600d5b782 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:47.424128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4bda5c97-3f3b-4f79-b627-217600d5b782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:47.443243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:47.445173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:47.447201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:47.447201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:47.447201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:47.451662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 357/731] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:47.456264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5c97-3f3b-4f79-b627-217600d5b782 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:47.509322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c719d3-dd12-4b06-9012-eeaa12ee9a0f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:47.547725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebdbc1-6194-4bf4-b3a4-bac14e684e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:47.548252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebdbc1-6194-4bf4-b3a4-bac14e684e21 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:47.548527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebdbc1-6194-4bf4-b3a4-bac14e684e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:47.548798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebdbc1-6194-4bf4-b3a4-bac14e684e21 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:47.549533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebdbc1-6194-4bf4-b3a4-bac14e684e21 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:47.549833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebdbc1-6194-4bf4-b3a4-bac14e684e21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:47.551277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebdbc1-6194-4bf4-b3a4-bac14e684e21 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:47.571048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 375/732] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 6 04:19:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:47.572717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089e4da-77be-418f-ab72-27611d8098fa None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:47.573174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089e4da-77be-418f-ab72-27611d8098fa None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:47.573621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089e4da-77be-418f-ab72-27611d8098fa None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:47.575839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 376/733] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:47.576398 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5c97-3f3b-4f79-b627-217600d5b782 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:47.580056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089e4da-77be-418f-ab72-27611d8098fa None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:47.610327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d794fe-73ad-414d-9bc1-c93204422cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:47.610954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d794fe-73ad-414d-9bc1-c93204422cfb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:47.611228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d794fe-73ad-414d-9bc1-c93204422cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:47.611572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d794fe-73ad-414d-9bc1-c93204422cfb None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:47.612148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d794fe-73ad-414d-9bc1-c93204422cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:47.612443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d794fe-73ad-414d-9bc1-c93204422cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:47.614041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d794fe-73ad-414d-9bc1-c93204422cfb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:47.630805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 358/734] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:47.632105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc2f55-ccb1-4a0f-b17a-624cf5571a54 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:47.632387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc2f55-ccb1-4a0f-b17a-624cf5571a54 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:47.632636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc2f55-ccb1-4a0f-b17a-624cf5571a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:47.649934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:47.656025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-99fc2f55-ccb1-4a0f-b17a-624cf5571a54 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:47.657586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-99fc2f55-ccb1-4a0f-b17a-624cf5571a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:47.674915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:47.702604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089e4da-77be-418f-ab72-27611d8098fa None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:47.745395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 359/735] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:47.745595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9c5cc-d9af-4ec1-995f-bad82aec98e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:47.746276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9c5cc-d9af-4ec1-995f-bad82aec98e0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:47.746609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9c5cc-d9af-4ec1-995f-bad82aec98e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:47.746881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9c5cc-d9af-4ec1-995f-bad82aec98e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:47.747528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc2f55-ccb1-4a0f-b17a-624cf5571a54 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:47.821481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9c5cc-d9af-4ec1-995f-bad82aec98e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:47.823277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9c5cc-d9af-4ec1-995f-bad82aec98e0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:47.909989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc2f55-ccb1-4a0f-b17a-624cf5571a54 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:47.962767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:47.974640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1be69-b5d1-4b09-90ef-8ac1ab26039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:47.975912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1be69-b5d1-4b09-90ef-8ac1ab26039c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:47.976431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1be69-b5d1-4b09-90ef-8ac1ab26039c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:47.977200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1be69-b5d1-4b09-90ef-8ac1ab26039c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:47.979523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:47.986434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1be69-b5d1-4b09-90ef-8ac1ab26039c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:47.988189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1be69-b5d1-4b09-90ef-8ac1ab26039c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-5ab1be69-b5d1-4b09-90ef-8ac1ab26039c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:48.003729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:48.004731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:48.005666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:48.005666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:48.005666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:48.005666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:48.005666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:48.005666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:48.005666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:48.005666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:48.005666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:19:48.005666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:48.009000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 360/736] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 6 04:19:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:48.015118 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 377/737] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:48.016417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1be69-b5d1-4b09-90ef-8ac1ab26039c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:48.022062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9c5cc-d9af-4ec1-995f-bad82aec98e0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:48.144242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9c5cc-d9af-4ec1-995f-bad82aec98e0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:48.166158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1be69-b5d1-4b09-90ef-8ac1ab26039c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:48.184668 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d4252-4baa-43fe-8b79-a61f5cf7fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:48.185588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d4252-4baa-43fe-8b79-a61f5cf7fb90 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.186136 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d4252-4baa-43fe-8b79-a61f5cf7fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.186608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d4252-4baa-43fe-8b79-a61f5cf7fb90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.199423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d4252-4baa-43fe-8b79-a61f5cf7fb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:48.200370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787831a0-34ac-443d-ae85-2c6e3c811653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:48.200972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787831a0-34ac-443d-ae85-2c6e3c811653 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.201245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787831a0-34ac-443d-ae85-2c6e3c811653 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.201516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787831a0-34ac-443d-ae85-2c6e3c811653 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.201953 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d4252-4baa-43fe-8b79-a61f5cf7fb90 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:48.202392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787831a0-34ac-443d-ae85-2c6e3c811653 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:48.202709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787831a0-34ac-443d-ae85-2c6e3c811653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:48.204258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787831a0-34ac-443d-ae85-2c6e3c811653 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d25d4252-4baa-43fe-8b79-a61f5cf7fb90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:48.221791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:48.222811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:48.223742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:48.223742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:48.223742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:48.223941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 361/738] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Oct 6 04:19:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:48.223941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787831a0-34ac-443d-ae85-2c6e3c811653 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:48.226071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 378/739] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:48.228191 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d4252-4baa-43fe-8b79-a61f5cf7fb90 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:48.267682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:48.286784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:48.339662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787831a0-34ac-443d-ae85-2c6e3c811653 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:48.360987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d4252-4baa-43fe-8b79-a61f5cf7fb90 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:48.375979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de12f9-031f-442e-b2df-e95a7c538935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:48.376587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de12f9-031f-442e-b2df-e95a7c538935 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.377084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de12f9-031f-442e-b2df-e95a7c538935 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.377194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de12f9-031f-442e-b2df-e95a7c538935 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.377755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de12f9-031f-442e-b2df-e95a7c538935 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:48.379125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de12f9-031f-442e-b2df-e95a7c538935 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:48.395859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 362/740] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:19:48 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:19:48.396632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de12f9-031f-442e-b2df-e95a7c538935 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:48.421923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9184f-09c4-47b1-82d1-15ad9d8a3bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:48.422562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9184f-09c4-47b1-82d1-15ad9d8a3bcd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.422834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9184f-09c4-47b1-82d1-15ad9d8a3bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.423096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9184f-09c4-47b1-82d1-15ad9d8a3bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.503965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9184f-09c4-47b1-82d1-15ad9d8a3bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:48.505741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9184f-09c4-47b1-82d1-15ad9d8a3bcd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:48.512252 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de12f9-031f-442e-b2df-e95a7c538935 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:48.526433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:48.538285 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:48.551721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217e580-0e93-4c10-bfdc-99a4da617506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:48.552361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217e580-0e93-4c10-bfdc-99a4da617506 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.552634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217e580-0e93-4c10-bfdc-99a4da617506 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.552905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217e580-0e93-4c10-bfdc-99a4da617506 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.553566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217e580-0e93-4c10-bfdc-99a4da617506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:48.553865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217e580-0e93-4c10-bfdc-99a4da617506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:48.555295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217e580-0e93-4c10-bfdc-99a4da617506 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:48.569703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 363/741] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:48.571417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35af70-df6d-464e-8340-ebb07615c529 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.572042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35af70-df6d-464e-8340-ebb07615c529 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.572542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35af70-df6d-464e-8340-ebb07615c529 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.575358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 364/742] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:48.575510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167abb3-433e-4797-bf1a-8d2dff8a71c7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.575746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167abb3-433e-4797-bf1a-8d2dff8a71c7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.575943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167abb3-433e-4797-bf1a-8d2dff8a71c7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.581520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 365/743] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:48.582697 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167abb3-433e-4797-bf1a-8d2dff8a71c7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:48.637311 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 379/744] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:48 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 04:19:48.638872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1829c-f899-4813-a5ac-2c4119a837e7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.639392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1829c-f899-4813-a5ac-2c4119a837e7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.639910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1829c-f899-4813-a5ac-2c4119a837e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.657960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-78d1829c-f899-4813-a5ac-2c4119a837e7 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:48.659050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-78d1829c-f899-4813-a5ac-2c4119a837e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:48.692222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167abb3-433e-4797-bf1a-8d2dff8a71c7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:48.729165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 380/745] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:48.730446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360cdbd-ba87-484c-8f9a-bb3df872c3d6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.730723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360cdbd-ba87-484c-8f9a-bb3df872c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.730988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360cdbd-ba87-484c-8f9a-bb3df872c3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.742095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f012b-b5b7-41a0-8b5a-bff758708d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:48.743019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f012b-b5b7-41a0-8b5a-bff758708d8b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.743612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f012b-b5b7-41a0-8b5a-bff758708d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.744201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f012b-b5b7-41a0-8b5a-bff758708d8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.752363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f012b-b5b7-41a0-8b5a-bff758708d8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:48.753970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f012b-b5b7-41a0-8b5a-bff758708d8b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:48.756042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1360cdbd-ba87-484c-8f9a-bb3df872c3d6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:48.757222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1360cdbd-ba87-484c-8f9a-bb3df872c3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c54f012b-b5b7-41a0-8b5a-bff758708d8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:48.767123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:48.768103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:48.769005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:48.769005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:48.769005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:48.769005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:48.769005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:48.769005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:48.769005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:48.769005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:48.771678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 366/746] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:48.772719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f012b-b5b7-41a0-8b5a-bff758708d8b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:48.816816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:48.820718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:48.845822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 381/747] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 04:19:48.847103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360cdbd-ba87-484c-8f9a-bb3df872c3d6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:48.907219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f012b-b5b7-41a0-8b5a-bff758708d8b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:48.949342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691ad31-c7ad-4037-a89e-b52704b52ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:48.950016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691ad31-c7ad-4037-a89e-b52704b52ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:48.950256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691ad31-c7ad-4037-a89e-b52704b52ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:48.950523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691ad31-c7ad-4037-a89e-b52704b52ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:48.957456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360cdbd-ba87-484c-8f9a-bb3df872c3d6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:48.962895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691ad31-c7ad-4037-a89e-b52704b52ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:48.964400 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691ad31-c7ad-4037-a89e-b52704b52ce3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6691ad31-c7ad-4037-a89e-b52704b52ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:48.978924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:48.980074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:48.981213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:48.981213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:48.981213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:48.981213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 367/748] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:48.985951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691ad31-c7ad-4037-a89e-b52704b52ce3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:49.004543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b43332-3929-442d-a753-9a6d743cc17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:49.005475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b43332-3929-442d-a753-9a6d743cc17b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:49.005937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b43332-3929-442d-a753-9a6d743cc17b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:49.006353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b43332-3929-442d-a753-9a6d743cc17b None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:49.007245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b43332-3929-442d-a753-9a6d743cc17b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:49.007712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b43332-3929-442d-a753-9a6d743cc17b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:49.009389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b43332-3929-442d-a753-9a6d743cc17b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:49.029908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 382/749] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:49.031648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b43332-3929-442d-a753-9a6d743cc17b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:49.079134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:49.096237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691ad31-c7ad-4037-a89e-b52704b52ce3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:49.105069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:49.132189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2d305-932f-4781-b610-e0f5a5b14691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:49.132798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2d305-932f-4781-b610-e0f5a5b14691 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:49.133058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2d305-932f-4781-b610-e0f5a5b14691 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:49.133321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2d305-932f-4781-b610-e0f5a5b14691 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:49.133953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2d305-932f-4781-b610-e0f5a5b14691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:49.134249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2d305-932f-4781-b610-e0f5a5b14691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:49.135629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2d305-932f-4781-b610-e0f5a5b14691 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:49.148059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 368/750] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:49.148870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2d305-932f-4781-b610-e0f5a5b14691 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:49.178712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b43332-3929-442d-a753-9a6d743cc17b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:49.215475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf4c30-ca4c-479f-b04c-0410dbdd4f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:49.216024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf4c30-ca4c-479f-b04c-0410dbdd4f00 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:49.216299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf4c30-ca4c-479f-b04c-0410dbdd4f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:49.216569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf4c30-ca4c-479f-b04c-0410dbdd4f00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:49.227027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf4c30-ca4c-479f-b04c-0410dbdd4f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9bcf4c30-ca4c-479f-b04c-0410dbdd4f00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:49.232280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:49.233254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:49.234264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 383/751] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:49.234963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf4c30-ca4c-479f-b04c-0410dbdd4f00 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:49.262040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2d305-932f-4781-b610-e0f5a5b14691 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:49.297562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9e424-460c-4a29-bb9c-98042626cec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:49.298190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9e424-460c-4a29-bb9c-98042626cec5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:49.298462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9e424-460c-4a29-bb9c-98042626cec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:49.298711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9e424-460c-4a29-bb9c-98042626cec5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:49.299482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9e424-460c-4a29-bb9c-98042626cec5 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=e6bea894013f40638404395075ade90d, user.id=85602a9d62bc475fb5da609f97958d5f) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:49.299786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9e424-460c-4a29-bb9c-98042626cec5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:49.301199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9e424-460c-4a29-bb9c-98042626cec5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:49.315358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 369/752] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:49 2022] GET /identity/v3/role_assignments?user.id=85602a9d62bc475fb5da609f97958d5f&scope.project.id=e6bea894013f40638404395075ade90d&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:49.315358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9e424-460c-4a29-bb9c-98042626cec5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:49.329544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:49.368965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf4c30-ca4c-479f-b04c-0410dbdd4f00 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:49.380872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:49.424028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40e5fb-c308-45be-bfc8-029a5a92792c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:49.424969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40e5fb-c308-45be-bfc8-029a5a92792c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:49.425733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40e5fb-c308-45be-bfc8-029a5a92792c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:49.426172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40e5fb-c308-45be-bfc8-029a5a92792c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:49.437267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40e5fb-c308-45be-bfc8-029a5a92792c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:49.440091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40e5fb-c308-45be-bfc8-029a5a92792c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:49.449755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9e424-460c-4a29-bb9c-98042626cec5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1f40e5fb-c308-45be-bfc8-029a5a92792c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:49.459213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:49.460370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:49.461486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:49.461486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:49.461486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:49.461486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:49.461486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:49.461486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:49.461486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:49.461486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:49.464298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 384/753] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:49.465534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40e5fb-c308-45be-bfc8-029a5a92792c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:49.497114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb753f-0d49-4200-8853-bc6331430cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:49.497454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb753f-0d49-4200-8853-bc6331430cbb None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:49.497764 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb753f-0d49-4200-8853-bc6331430cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:49.498963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb753f-0d49-4200-8853-bc6331430cbb None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:49.502976 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb753f-0d49-4200-8853-bc6331430cbb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:49.503929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb753f-0d49-4200-8853-bc6331430cbb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:49.529179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 370/754] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:19:49 2022] POST /identity/v3/services => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:19:49.530530 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb753f-0d49-4200-8853-bc6331430cbb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:49.596482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40e5fb-c308-45be-bfc8-029a5a92792c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:49.623081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:49.647703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08c216-cf37-4b9a-b30e-d6de6cc8fde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:49.648317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08c216-cf37-4b9a-b30e-d6de6cc8fde7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:49.648593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08c216-cf37-4b9a-b30e-d6de6cc8fde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:49.648858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08c216-cf37-4b9a-b30e-d6de6cc8fde7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:49.649855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08c216-cf37-4b9a-b30e-d6de6cc8fde7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:49.650172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08c216-cf37-4b9a-b30e-d6de6cc8fde7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:49.652132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08c216-cf37-4b9a-b30e-d6de6cc8fde7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:49.680394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 385/755] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:49.684160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08c216-cf37-4b9a-b30e-d6de6cc8fde7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:49.689845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb753f-0d49-4200-8853-bc6331430cbb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:49.740707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:49.751458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8341eb0-cb02-4745-bd0c-5f1667afb354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:49.752578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8341eb0-cb02-4745-bd0c-5f1667afb354 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:49.753019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8341eb0-cb02-4745-bd0c-5f1667afb354 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:49.753444 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8341eb0-cb02-4745-bd0c-5f1667afb354 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:49.754302 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8341eb0-cb02-4745-bd0c-5f1667afb354 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:49.754748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8341eb0-cb02-4745-bd0c-5f1667afb354 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:49.756522 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8341eb0-cb02-4745-bd0c-5f1667afb354 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:49.777599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 371/756] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:49.784926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8341eb0-cb02-4745-bd0c-5f1667afb354 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:49.860106 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08c216-cf37-4b9a-b30e-d6de6cc8fde7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:49.902893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8341eb0-cb02-4745-bd0c-5f1667afb354 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:49.907390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253962-119c-4972-9b02-5342798228f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:49.908252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253962-119c-4972-9b02-5342798228f0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:49.908807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253962-119c-4972-9b02-5342798228f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:49.909207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253962-119c-4972-9b02-5342798228f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:49.925684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c253962-119c-4972-9b02-5342798228f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:49.927140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c253962-119c-4972-9b02-5342798228f0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:49.937474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4c253962-119c-4972-9b02-5342798228f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:49.946080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:49.947259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:49.948282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:49.948282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:49.948282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:49.948465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea58f97-bdad-4563-b8c9-0aa93aa63e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:49.948465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea58f97-bdad-4563-b8c9-0aa93aa63e3f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:49.948465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea58f97-bdad-4563-b8c9-0aa93aa63e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:49.948465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea58f97-bdad-4563-b8c9-0aa93aa63e3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:49.948730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea58f97-bdad-4563-b8c9-0aa93aa63e3f None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=cdff0406366845169a481e3cd1188725) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:49.948730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea58f97-bdad-4563-b8c9-0aa93aa63e3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:49.950131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea58f97-bdad-4563-b8c9-0aa93aa63e3f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:49.951361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 386/757] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:49.957647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 372/758] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:49 2022] GET /identity/v3/role_assignments?user.id=cdff0406366845169a481e3cd1188725&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:49.959676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253962-119c-4972-9b02-5342798228f0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:50.061496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:50.098914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253962-119c-4972-9b02-5342798228f0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:50.150946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689064ea-61ba-4931-b688-251cd366bcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:50.151603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689064ea-61ba-4931-b688-251cd366bcaa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:50.151882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689064ea-61ba-4931-b688-251cd366bcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:50.152146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689064ea-61ba-4931-b688-251cd366bcaa None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:50.152804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689064ea-61ba-4931-b688-251cd366bcaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:50.153103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689064ea-61ba-4931-b688-251cd366bcaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:50.154582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689064ea-61ba-4931-b688-251cd366bcaa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:50.176722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 387/759] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:50.182447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea58f97-bdad-4563-b8c9-0aa93aa63e3f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:50.308656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea58f97-bdad-4563-b8c9-0aa93aa63e3f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:50.352609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b99a7-6630-4571-a579-d52dcae97b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:50.353260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b99a7-6630-4571-a579-d52dcae97b7a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:50.353537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b99a7-6630-4571-a579-d52dcae97b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:50.353805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b99a7-6630-4571-a579-d52dcae97b7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:50.363407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b99a7-6630-4571-a579-d52dcae97b7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:50.364887 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b99a7-6630-4571-a579-d52dcae97b7a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a31b99a7-6630-4571-a579-d52dcae97b7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:50.383564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:50.384562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:50.385492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 373/760] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 6 04:19:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:50.390631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689064ea-61ba-4931-b688-251cd366bcaa None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:50.551295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689064ea-61ba-4931-b688-251cd366bcaa None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:50.598565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f99e06-fd51-4241-9804-9ee72da2133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:50.599110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99e06-fd51-4241-9804-9ee72da2133d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:50.599414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99e06-fd51-4241-9804-9ee72da2133d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:50.599686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99e06-fd51-4241-9804-9ee72da2133d None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:50.600434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f99e06-fd51-4241-9804-9ee72da2133d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:50.600739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f99e06-fd51-4241-9804-9ee72da2133d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:50.602193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f99e06-fd51-4241-9804-9ee72da2133d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:50.608505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:50.626199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 388/761] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 6 04:19:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:50.631592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b99a7-6630-4571-a579-d52dcae97b7a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:50.822720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:50.891056 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b99a7-6630-4571-a579-d52dcae97b7a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:50.941762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feafb1c-a383-4b66-bc4d-0b914d968bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:50.942460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feafb1c-a383-4b66-bc4d-0b914d968bcf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:50.942730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feafb1c-a383-4b66-bc4d-0b914d968bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:50.942989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feafb1c-a383-4b66-bc4d-0b914d968bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:50.956804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feafb1c-a383-4b66-bc4d-0b914d968bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:50.958276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feafb1c-a383-4b66-bc4d-0b914d968bcf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6feafb1c-a383-4b66-bc4d-0b914d968bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:50.983425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:50.984464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:50.985356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:50.985356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:50.985356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:50.985356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 374/762] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:50.990285 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f99e06-fd51-4241-9804-9ee72da2133d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:51.114734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f99e06-fd51-4241-9804-9ee72da2133d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:51.155956 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7a2e0-b552-4dac-8bbb-7c46d31615d7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:51.156175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7a2e0-b552-4dac-8bbb-7c46d31615d7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:51.156402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7a2e0-b552-4dac-8bbb-7c46d31615d7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:51.159053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 375/763] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:51.163085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c0d34-af5a-4b72-a3c0-888794b50c6a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:51.163402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c0d34-af5a-4b72-a3c0-888794b50c6a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:51.163655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c0d34-af5a-4b72-a3c0-888794b50c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:51.164427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7b547-b050-49f8-a2a6-fd23f734e65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:51.165279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7b547-b050-49f8-a2a6-fd23f734e65a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:51.165755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7b547-b050-49f8-a2a6-fd23f734e65a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:51.166219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7b547-b050-49f8-a2a6-fd23f734e65a None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:51.167186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7b547-b050-49f8-a2a6-fd23f734e65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:51.167756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7b547-b050-49f8-a2a6-fd23f734e65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:51.169391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7b547-b050-49f8-a2a6-fd23f734e65a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:51.187888 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8c0c0d34-af5a-4b72-a3c0-888794b50c6a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:51.188380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 389/764] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:51.189505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8c0c0d34-af5a-4b72-a3c0-888794b50c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:51.195367 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7b547-b050-49f8-a2a6-fd23f734e65a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:51.320130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:51.321665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 376/765] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:19:51.397032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7b547-b050-49f8-a2a6-fd23f734e65a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:51.442676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbf419-1ee9-4b35-bbca-79a26e131e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:51.443326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbf419-1ee9-4b35-bbca-79a26e131e21 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:51.443605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbf419-1ee9-4b35-bbca-79a26e131e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:51.443873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbf419-1ee9-4b35-bbca-79a26e131e21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:51.450811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbf419-1ee9-4b35-bbca-79a26e131e21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:51.452303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbf419-1ee9-4b35-bbca-79a26e131e21 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-67fbf419-1ee9-4b35-bbca-79a26e131e21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:51.466467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:51.467427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:51.468937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:51.468937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:51.468937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:51.468937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:51.468937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:51.468937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:51.468937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:51.468937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:51.470899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 390/766] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:51.476096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c0d34-af5a-4b72-a3c0-888794b50c6a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:51.563731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:51.630310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c0d34-af5a-4b72-a3c0-888794b50c6a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:51.666528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a558-3bcb-44ce-b3ff-192c1a738707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:51.667602 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a558-3bcb-44ce-b3ff-192c1a738707 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:51.668081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a558-3bcb-44ce-b3ff-192c1a738707 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:51.668549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a558-3bcb-44ce-b3ff-192c1a738707 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:51.669435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a558-3bcb-44ce-b3ff-192c1a738707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:51.669972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a558-3bcb-44ce-b3ff-192c1a738707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:51.672184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a558-3bcb-44ce-b3ff-192c1a738707 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:51.682481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbf419-1ee9-4b35-bbca-79a26e131e21 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:51.685388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 377/767] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:51.692359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a558-3bcb-44ce-b3ff-192c1a738707 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:51.799385 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:51.803857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a558-3bcb-44ce-b3ff-192c1a738707 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:51.845266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182a2ab-c94f-464b-96dc-4a06a809fb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:51.846387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182a2ab-c94f-464b-96dc-4a06a809fb83 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:51.846932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182a2ab-c94f-464b-96dc-4a06a809fb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:51.847465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182a2ab-c94f-464b-96dc-4a06a809fb83 None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/0481d4c0be0b46189e339d1e00bee4c0/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:51.849967 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182a2ab-c94f-464b-96dc-4a06a809fb83 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=0481d4c0be0b46189e339d1e00bee4c0, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:51.851805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182a2ab-c94f-464b-96dc-4a06a809fb83 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:51.872500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 378/768] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:19:51 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/0481d4c0be0b46189e339d1e00bee4c0/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:19:51.953939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbf419-1ee9-4b35-bbca-79a26e131e21 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:51.968757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:51.972839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fce5c-3146-4841-9e75-10c596a83768 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:51.973340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fce5c-3146-4841-9e75-10c596a83768 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:51.973419 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fce5c-3146-4841-9e75-10c596a83768 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:51.975244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 379/769] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:51.980746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f5c4-437e-4040-bad6-8e68394dc225 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:51.981029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f5c4-437e-4040-bad6-8e68394dc225 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:51.981435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f5c4-437e-4040-bad6-8e68394dc225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.005848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85792-0f17-4784-b38c-0caaf3d6ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:52.007172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85792-0f17-4784-b38c-0caaf3d6ced4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:52.007740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85792-0f17-4784-b38c-0caaf3d6ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:52.008205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85792-0f17-4784-b38c-0caaf3d6ced4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.009075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85792-0f17-4784-b38c-0caaf3d6ced4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:52.010651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85792-0f17-4784-b38c-0caaf3d6ced4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:52.024237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3320f5c4-437e-4040-bad6-8e68394dc225 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:52.025774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3320f5c4-437e-4040-bad6-8e68394dc225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-70b85792-0f17-4784-b38c-0caaf3d6ced4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:52.031641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:52.032680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 04:19:52.033517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:52.043633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 391/770] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Oct 6 04:19:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:52.048321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85792-0f17-4784-b38c-0caaf3d6ced4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:52.169290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 380/771] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:19:52.178895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85792-0f17-4784-b38c-0caaf3d6ced4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:52.215973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fcb5e-6af6-469f-a65f-2cd06e2da8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:52.216707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fcb5e-6af6-469f-a65f-2cd06e2da8bc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:52.217044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fcb5e-6af6-469f-a65f-2cd06e2da8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:52.217393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fcb5e-6af6-469f-a65f-2cd06e2da8bc None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.218778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fcb5e-6af6-469f-a65f-2cd06e2da8bc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:52.219159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fcb5e-6af6-469f-a65f-2cd06e2da8bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:52.220701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fcb5e-6af6-469f-a65f-2cd06e2da8bc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:52.226304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 392/772] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 6 04:19:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:52.232004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320f5c4-437e-4040-bad6-8e68394dc225 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:52.245525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e412c1-f787-424b-bb49-2a8da6154055 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:52.245847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e412c1-f787-424b-bb49-2a8da6154055 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:52.246074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e412c1-f787-424b-bb49-2a8da6154055 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.247834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 393/773] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:19:52.254015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b315525-de7b-47f6-95e2-1e4fa70f9a3c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:52.254294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b315525-de7b-47f6-95e2-1e4fa70f9a3c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:52.254565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b315525-de7b-47f6-95e2-1e4fa70f9a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.283816 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6b315525-de7b-47f6-95e2-1e4fa70f9a3c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:52.285030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6b315525-de7b-47f6-95e2-1e4fa70f9a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:52.360466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:52.394330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:52.427928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 394/774] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:19:52.428107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320f5c4-437e-4040-bad6-8e68394dc225 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:52.454836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b315525-de7b-47f6-95e2-1e4fa70f9a3c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:52.495464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d2e01-dbb5-4de0-b217-24b6d1f66c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:52.496077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d2e01-dbb5-4de0-b217-24b6d1f66c86 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:52.496349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d2e01-dbb5-4de0-b217-24b6d1f66c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:52.496616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d2e01-dbb5-4de0-b217-24b6d1f66c86 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.497237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d2e01-dbb5-4de0-b217-24b6d1f66c86 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:52.497531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d2e01-dbb5-4de0-b217-24b6d1f66c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:52.498936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d2e01-dbb5-4de0-b217-24b6d1f66c86 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:52.510488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 381/775] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 6 04:19:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:52.517068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d2e01-dbb5-4de0-b217-24b6d1f66c86 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:52.611986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b315525-de7b-47f6-95e2-1e4fa70f9a3c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:52.647532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d2e01-dbb5-4de0-b217-24b6d1f66c86 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:52.685619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b7641-191a-48b7-adae-275d9037fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:52.686181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b7641-191a-48b7-adae-275d9037fd66 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:52.686499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b7641-191a-48b7-adae-275d9037fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:52.687293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b7641-191a-48b7-adae-275d9037fd66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.697671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d880c-b8cd-4270-be56-52830650db6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:52.698312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d880c-b8cd-4270-be56-52830650db6e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:52.698580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d880c-b8cd-4270-be56-52830650db6e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:52.698847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d880c-b8cd-4270-be56-52830650db6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.700696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d880c-b8cd-4270-be56-52830650db6e None admin] RBAC: Adding query filter params (interface=public, service_id=25e3104eb47c493db295869e7c4c6b48, region_id=RegionOne) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:52.700696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d880c-b8cd-4270-be56-52830650db6e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:52.701420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d880c-b8cd-4270-be56-52830650db6e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:52.706102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b7641-191a-48b7-adae-275d9037fd66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:52.711152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 382/776] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 6 04:19:52 2022] GET /identity/v3/endpoints?service_id=25e3104eb47c493db295869e7c4c6b48&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-168b7641-191a-48b7-adae-275d9037fd66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:52.711977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:52.713077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:52.713956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:52.716364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d880c-b8cd-4270-be56-52830650db6e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:52.717022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 395/777] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:52.722445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b7641-191a-48b7-adae-275d9037fd66 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:52.736278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:52.758629 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:52.830485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d880c-b8cd-4270-be56-52830650db6e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:52.854282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b7641-191a-48b7-adae-275d9037fd66 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:52.865468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ea998-e479-4c25-86e2-8e313fe6a38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:52.866476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea998-e479-4c25-86e2-8e313fe6a38e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:52.866751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea998-e479-4c25-86e2-8e313fe6a38e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:52.867018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea998-e479-4c25-86e2-8e313fe6a38e None admin] PATH_INFO: `/v3/services/network` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.867627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ea998-e479-4c25-86e2-8e313fe6a38e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:52.869012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ea998-e479-4c25-86e2-8e313fe6a38e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b92ea998-e479-4c25-86e2-8e313fe6a38e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:52.878014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:52.879047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:52.880036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 383/778] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:52 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:52.880858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ea998-e479-4c25-86e2-8e313fe6a38e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:52.900666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f943b-fe11-472e-bc77-be05b6e37b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:52.901293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f943b-fe11-472e-bc77-be05b6e37b05 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:52.901563 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f943b-fe11-472e-bc77-be05b6e37b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:52.901832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f943b-fe11-472e-bc77-be05b6e37b05 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.902447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f943b-fe11-472e-bc77-be05b6e37b05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:52.903884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f943b-fe11-472e-bc77-be05b6e37b05 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:52.910519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 396/779] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 6 04:19:52 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:52.911767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db9631-3fe3-421a-9356-0bc6efde2635 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:52.912047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db9631-3fe3-421a-9356-0bc6efde2635 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:52.912321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db9631-3fe3-421a-9356-0bc6efde2635 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:52.915447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 397/780] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:52.915447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db9631-3fe3-421a-9356-0bc6efde2635 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:53.000380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:53.034732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ea998-e479-4c25-86e2-8e313fe6a38e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:53.038308 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:53.047767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db9631-3fe3-421a-9356-0bc6efde2635 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:53.081060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddfb49-d65f-4845-a7c6-c3825c7e379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:53.081955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddfb49-d65f-4845-a7c6-c3825c7e379f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.081955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddfb49-d65f-4845-a7c6-c3825c7e379f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.082246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddfb49-d65f-4845-a7c6-c3825c7e379f None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.082879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddfb49-d65f-4845-a7c6-c3825c7e379f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:53.083183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddfb49-d65f-4845-a7c6-c3825c7e379f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:53.084616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddfb49-d65f-4845-a7c6-c3825c7e379f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:53.091541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4353bf6-ff1e-458c-ad22-989656a7299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:53.092607 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4353bf6-ff1e-458c-ad22-989656a7299f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.093344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4353bf6-ff1e-458c-ad22-989656a7299f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.093926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4353bf6-ff1e-458c-ad22-989656a7299f None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.094871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4353bf6-ff1e-458c-ad22-989656a7299f None admin] RBAC: Adding query filter params (name=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:53.095409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4353bf6-ff1e-458c-ad22-989656a7299f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:53.097095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4353bf6-ff1e-458c-ad22-989656a7299f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:53.099796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 384/781] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:53.101053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9626a-08d7-4f1a-9b46-9bb69a7520cc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.101309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9626a-08d7-4f1a-9b46-9bb69a7520cc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.101605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9626a-08d7-4f1a-9b46-9bb69a7520cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.104501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 398/782] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:19:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:53.105520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4353bf6-ff1e-458c-ad22-989656a7299f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:53.121850 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c4d9626a-08d7-4f1a-9b46-9bb69a7520cc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:53.123437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c4d9626a-08d7-4f1a-9b46-9bb69a7520cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:53.196879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 385/783] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:19:53.197746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9626a-08d7-4f1a-9b46-9bb69a7520cc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:53.212193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4353bf6-ff1e-458c-ad22-989656a7299f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:53.247282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db94df-a300-4917-a34c-139f22c52269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:53.248339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db94df-a300-4917-a34c-139f22c52269 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.248862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db94df-a300-4917-a34c-139f22c52269 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.249394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db94df-a300-4917-a34c-139f22c52269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.260210 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db94df-a300-4917-a34c-139f22c52269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:53.261933 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db94df-a300-4917-a34c-139f22c52269 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-76db94df-a300-4917-a34c-139f22c52269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:53.277370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:53.278365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:53.279272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:53.279272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:53.279272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:53.281450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 399/784] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:53.288473 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db94df-a300-4917-a34c-139f22c52269 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:53.305113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:53.317985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:53.371066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9626a-08d7-4f1a-9b46-9bb69a7520cc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:53.415712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9c88f-3b84-417e-abce-4c239fdd863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:53.416977 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9c88f-3b84-417e-abce-4c239fdd863f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.417309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9c88f-3b84-417e-abce-4c239fdd863f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.417584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9c88f-3b84-417e-abce-4c239fdd863f None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.418219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9c88f-3b84-417e-abce-4c239fdd863f None admin] RBAC: Adding query filter params (type=network) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:53.418527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9c88f-3b84-417e-abce-4c239fdd863f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:53.419951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9c88f-3b84-417e-abce-4c239fdd863f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:53.425988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 386/785] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:19:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:53.431646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9c88f-3b84-417e-abce-4c239fdd863f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:53.509588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db94df-a300-4917-a34c-139f22c52269 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:53.557758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9c88f-3b84-417e-abce-4c239fdd863f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:53.562186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a10be-5cc2-4431-9c0e-82bf5a0f7796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:53.562756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a10be-5cc2-4431-9c0e-82bf5a0f7796 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.563034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a10be-5cc2-4431-9c0e-82bf5a0f7796 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.563327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a10be-5cc2-4431-9c0e-82bf5a0f7796 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.563985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a10be-5cc2-4431-9c0e-82bf5a0f7796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:53.564287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a10be-5cc2-4431-9c0e-82bf5a0f7796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:53.565667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a10be-5cc2-4431-9c0e-82bf5a0f7796 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:53.583832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 400/786] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:53.584888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a10be-5cc2-4431-9c0e-82bf5a0f7796 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:53.598316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:53.605167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258f3f-1325-4e09-9413-ccfd36f6b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:53.605995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258f3f-1325-4e09-9413-ccfd36f6b61a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.606428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258f3f-1325-4e09-9413-ccfd36f6b61a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.606843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258f3f-1325-4e09-9413-ccfd36f6b61a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.607813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258f3f-1325-4e09-9413-ccfd36f6b61a None admin] RBAC: Adding query filter params (interface=public, service_id=a645a4ba2eb34f4b9d6bb1f4966abe5e, region_id=RegionOne) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:53.608830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258f3f-1325-4e09-9413-ccfd36f6b61a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:53.610386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258f3f-1325-4e09-9413-ccfd36f6b61a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:53.621220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 387/787] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 6 04:19:53 2022] GET /identity/v3/endpoints?service_id=a645a4ba2eb34f4b9d6bb1f4966abe5e&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:53.622376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258f3f-1325-4e09-9413-ccfd36f6b61a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:53.674814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:53.711695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a10be-5cc2-4431-9c0e-82bf5a0f7796 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:53.737657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258f3f-1325-4e09-9413-ccfd36f6b61a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:53.752700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec40933-c2db-4438-9f73-5c7410187be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:53.753505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec40933-c2db-4438-9f73-5c7410187be9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.753787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec40933-c2db-4438-9f73-5c7410187be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.754046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec40933-c2db-4438-9f73-5c7410187be9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.766489 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec40933-c2db-4438-9f73-5c7410187be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-bec40933-c2db-4438-9f73-5c7410187be9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:53.772806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:53.773950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 401/788] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:53.780215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec40933-c2db-4438-9f73-5c7410187be9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:53.789895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389dad2-3d49-44d8-b240-6feb05cd7ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:53.790830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389dad2-3d49-44d8-b240-6feb05cd7ade None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.791291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389dad2-3d49-44d8-b240-6feb05cd7ade None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.791805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389dad2-3d49-44d8-b240-6feb05cd7ade None admin] PATH_INFO: `/v3/users/swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.803935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389dad2-3d49-44d8-b240-6feb05cd7ade None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:53.805898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389dad2-3d49-44d8-b240-6feb05cd7ade None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-3389dad2-3d49-44d8-b240-6feb05cd7ade None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:53.821268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:53.822238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:53.823344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:53.823344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:53.823344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:53.823344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:53.823344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:53.823344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:53.823344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:53.823344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:53.823344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:53.823344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:53.827099 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 388/789] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:53.827988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389dad2-3d49-44d8-b240-6feb05cd7ade None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:53.897121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:53.898523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec40933-c2db-4438-9f73-5c7410187be9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:53.933262 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:53.941483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3b95a-da1b-4b2e-9ab9-7a45fa28fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:53.942553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b95a-da1b-4b2e-9ab9-7a45fa28fa5f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.943041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b95a-da1b-4b2e-9ab9-7a45fa28fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.943563 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b95a-da1b-4b2e-9ab9-7a45fa28fa5f None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.944472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3b95a-da1b-4b2e-9ab9-7a45fa28fa5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:53.946173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3b95a-da1b-4b2e-9ab9-7a45fa28fa5f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:53.948294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389dad2-3d49-44d8-b240-6feb05cd7ade None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:53.958463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 402/790] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 6 04:19:53 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:53.959925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3b95a-da1b-4b2e-9ab9-7a45fa28fa5f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:53.990557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90ccec-778c-488d-a3d9-7dfb69677204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:53.991582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90ccec-778c-488d-a3d9-7dfb69677204 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:53.991857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90ccec-778c-488d-a3d9-7dfb69677204 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:53.992136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90ccec-778c-488d-a3d9-7dfb69677204 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:53.992819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90ccec-778c-488d-a3d9-7dfb69677204 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:53.993423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90ccec-778c-488d-a3d9-7dfb69677204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:53.994815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90ccec-778c-488d-a3d9-7dfb69677204 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:54.005665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 389/791] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:54.018413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90ccec-778c-488d-a3d9-7dfb69677204 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:54.183027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3b95a-da1b-4b2e-9ab9-7a45fa28fa5f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:54.213740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90ccec-778c-488d-a3d9-7dfb69677204 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:54.251675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:54.261668 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da387463-a323-45a4-b320-ed159ab39fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:54.262340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387463-a323-45a4-b320-ed159ab39fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:54.262616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387463-a323-45a4-b320-ed159ab39fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:54.262879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387463-a323-45a4-b320-ed159ab39fe6 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:54.263900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da387463-a323-45a4-b320-ed159ab39fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:54.264213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da387463-a323-45a4-b320-ed159ab39fe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:54.266218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da387463-a323-45a4-b320-ed159ab39fe6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:54.279610 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895b99-d05a-41c5-afd8-355aba280d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:54.281161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895b99-d05a-41c5-afd8-355aba280d5b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:54.281645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895b99-d05a-41c5-afd8-355aba280d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:54.282112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895b99-d05a-41c5-afd8-355aba280d5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:54.290821 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 403/792] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 6 04:19:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:54.295568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04895b99-d05a-41c5-afd8-355aba280d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:54.296398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da387463-a323-45a4-b320-ed159ab39fe6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:54.298031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04895b99-d05a-41c5-afd8-355aba280d5b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-04895b99-d05a-41c5-afd8-355aba280d5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:54.319501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:54.320450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:54.321358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:54.321358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:54.321358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:54.323625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 390/793] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:54.331330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895b99-d05a-41c5-afd8-355aba280d5b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:54.399110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:54.451936 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da387463-a323-45a4-b320-ed159ab39fe6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:54.474405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895b99-d05a-41c5-afd8-355aba280d5b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:54.493169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93548c-d054-40c4-a5b7-a2a0314a5b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:54.493876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93548c-d054-40c4-a5b7-a2a0314a5b28 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:54.494150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93548c-d054-40c4-a5b7-a2a0314a5b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:54.494560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93548c-d054-40c4-a5b7-a2a0314a5b28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:54.506432 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93548c-d054-40c4-a5b7-a2a0314a5b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:54.508805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93548c-d054-40c4-a5b7-a2a0314a5b28 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:54.512618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecea23-99ca-4c06-a6bb-f3855cda7d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:54.513334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecea23-99ca-4c06-a6bb-f3855cda7d14 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:54.513706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecea23-99ca-4c06-a6bb-f3855cda7d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:54.514069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecea23-99ca-4c06-a6bb-f3855cda7d14 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:54.514946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecea23-99ca-4c06-a6bb-f3855cda7d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:54.515508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecea23-99ca-4c06-a6bb-f3855cda7d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:54.516978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecea23-99ca-4c06-a6bb-f3855cda7d14 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6e93548c-d054-40c4-a5b7-a2a0314a5b28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:54.524395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:54.525360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:54.526258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:54.526258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:54.526258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:54.526258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 404/794] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:54.527209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f922c-349a-4c20-8789-ca4ba7d1734d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:54.527503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f922c-349a-4c20-8789-ca4ba7d1734d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:54.527768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f922c-349a-4c20-8789-ca4ba7d1734d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:54.532604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 391/796] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:54.532732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 405/796] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:54.537194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f922c-349a-4c20-8789-ca4ba7d1734d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:54.537326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40c3f-032c-4268-838e-f2c16f418655 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:54.537326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40c3f-032c-4268-838e-f2c16f418655 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:54.537326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40c3f-032c-4268-838e-f2c16f418655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:54.560619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b6a40c3f-032c-4268-838e-f2c16f418655 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:54.561982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b6a40c3f-032c-4268-838e-f2c16f418655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:54.593365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:54.652207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 392/797] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:19:54.653216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40c3f-032c-4268-838e-f2c16f418655 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:54.765219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40c3f-032c-4268-838e-f2c16f418655 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:54.799045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f922c-349a-4c20-8789-ca4ba7d1734d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:54.807723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad0bc5-58b9-4cee-b2b2-33545a550bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:54.808363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad0bc5-58b9-4cee-b2b2-33545a550bef None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:54.808635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad0bc5-58b9-4cee-b2b2-33545a550bef None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:54.808899 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad0bc5-58b9-4cee-b2b2-33545a550bef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:54.809892 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:54.817857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad0bc5-58b9-4cee-b2b2-33545a550bef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:54.819350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad0bc5-58b9-4cee-b2b2-33545a550bef None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-94ad0bc5-58b9-4cee-b2b2-33545a550bef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:54.844747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:54.845767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:54.846741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 393/798] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 6 04:19:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:54.853846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad0bc5-58b9-4cee-b2b2-33545a550bef None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:54.884409 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:54.909800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405b8dc-cfbb-4e76-8840-1da9a0d7ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:54.911626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405b8dc-cfbb-4e76-8840-1da9a0d7ff0c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:54.912317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405b8dc-cfbb-4e76-8840-1da9a0d7ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:54.913945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405b8dc-cfbb-4e76-8840-1da9a0d7ff0c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:54.914806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405b8dc-cfbb-4e76-8840-1da9a0d7ff0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:54.916036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405b8dc-cfbb-4e76-8840-1da9a0d7ff0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:54.917841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405b8dc-cfbb-4e76-8840-1da9a0d7ff0c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:54.944605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 406/799] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:54.951531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405b8dc-cfbb-4e76-8840-1da9a0d7ff0c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.003721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad0bc5-58b9-4cee-b2b2-33545a550bef None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:55.038509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb53a6-03f4-4893-ad64-759ccb1571e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:55.039178 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb53a6-03f4-4893-ad64-759ccb1571e9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.039261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb53a6-03f4-4893-ad64-759ccb1571e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.039556 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb53a6-03f4-4893-ad64-759ccb1571e9 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.040293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb53a6-03f4-4893-ad64-759ccb1571e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:55.040599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb53a6-03f4-4893-ad64-759ccb1571e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:55.042147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb53a6-03f4-4893-ad64-759ccb1571e9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:55.065244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 394/800] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Oct 6 04:19:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:55.065244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb53a6-03f4-4893-ad64-759ccb1571e9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.074609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405b8dc-cfbb-4e76-8840-1da9a0d7ff0c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:55.109572 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250beb1f-ead9-44f8-b992-c1fb678a719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:55.110642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250beb1f-ead9-44f8-b992-c1fb678a719f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.111114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250beb1f-ead9-44f8-b992-c1fb678a719f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.111613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250beb1f-ead9-44f8-b992-c1fb678a719f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.119251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250beb1f-ead9-44f8-b992-c1fb678a719f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:55.121078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250beb1f-ead9-44f8-b992-c1fb678a719f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-250beb1f-ead9-44f8-b992-c1fb678a719f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:55.133747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:55.134704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:55.135637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:55.135637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:55.135637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:55.135637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:55.135637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:55.135637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:55.135637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:55.135637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:55.138153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 407/801] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:55.139261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250beb1f-ead9-44f8-b992-c1fb678a719f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.149478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:55.174278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb53a6-03f4-4893-ad64-759ccb1571e9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:55.174769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:55.213632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abb5ed-fd78-4570-ac05-0e684590ef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:55.214336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abb5ed-fd78-4570-ac05-0e684590ef29 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.214608 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abb5ed-fd78-4570-ac05-0e684590ef29 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.214872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abb5ed-fd78-4570-ac05-0e684590ef29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.227100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abb5ed-fd78-4570-ac05-0e684590ef29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-14abb5ed-fd78-4570-ac05-0e684590ef29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:55.232133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:55.233053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 395/802] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:55.234456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abb5ed-fd78-4570-ac05-0e684590ef29 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.261479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250beb1f-ead9-44f8-b992-c1fb678a719f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:55.296674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37824ce5-322a-4604-948a-65bc51b119f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:55.297656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37824ce5-322a-4604-948a-65bc51b119f3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.298137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37824ce5-322a-4604-948a-65bc51b119f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.298601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37824ce5-322a-4604-948a-65bc51b119f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.309749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37824ce5-322a-4604-948a-65bc51b119f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:55.311598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37824ce5-322a-4604-948a-65bc51b119f3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-37824ce5-322a-4604-948a-65bc51b119f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:55.330083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:55.331086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:55.332024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:55.332024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:55.332024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:55.332024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 408/803] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:55.332024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37824ce5-322a-4604-948a-65bc51b119f3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.351878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abb5ed-fd78-4570-ac05-0e684590ef29 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:55.386491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5342b-f7e8-4cc9-bd64-4c4ee86090c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:55.387101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5342b-f7e8-4cc9-bd64-4c4ee86090c8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.387408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5342b-f7e8-4cc9-bd64-4c4ee86090c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.387731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5342b-f7e8-4cc9-bd64-4c4ee86090c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.388421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5342b-f7e8-4cc9-bd64-4c4ee86090c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:55.388782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5342b-f7e8-4cc9-bd64-4c4ee86090c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:55.390334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5342b-f7e8-4cc9-bd64-4c4ee86090c8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:55.397290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:55.403204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 396/804] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:55.404816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5ddf4-56c8-46c6-8974-09d7ba0ceac7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.405264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5ddf4-56c8-46c6-8974-09d7ba0ceac7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.405596 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5ddf4-56c8-46c6-8974-09d7ba0ceac7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.411814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 397/805] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:55.411814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5ddf4-56c8-46c6-8974-09d7ba0ceac7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.424880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:55.448907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37824ce5-322a-4604-948a-65bc51b119f3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:55.485259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bd5e3-9a8d-4518-b42d-34269080c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:55.485956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bd5e3-9a8d-4518-b42d-34269080c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.486217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bd5e3-9a8d-4518-b42d-34269080c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.486485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bd5e3-9a8d-4518-b42d-34269080c3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.487184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bd5e3-9a8d-4518-b42d-34269080c3b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:55.487515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bd5e3-9a8d-4518-b42d-34269080c3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:55.488876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bd5e3-9a8d-4518-b42d-34269080c3b1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:55.502330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 409/806] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:55.502330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bd5e3-9a8d-4518-b42d-34269080c3b1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.516698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5ddf4-56c8-46c6-8974-09d7ba0ceac7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:55.553336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbe4b8-92ac-455c-b264-b554932d8b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:55.553868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe4b8-92ac-455c-b264-b554932d8b97 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.554152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe4b8-92ac-455c-b264-b554932d8b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.554405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe4b8-92ac-455c-b264-b554932d8b97 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.555046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbe4b8-92ac-455c-b264-b554932d8b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:55.555446 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbe4b8-92ac-455c-b264-b554932d8b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:55.556824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbe4b8-92ac-455c-b264-b554932d8b97 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:55.573131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 398/807] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:55.573131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9178319-6663-4daf-b065-46e6bc5cc3bb None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.573131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9178319-6663-4daf-b065-46e6bc5cc3bb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.573131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9178319-6663-4daf-b065-46e6bc5cc3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.588293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f9178319-6663-4daf-b065-46e6bc5cc3bb None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:55.589473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f9178319-6663-4daf-b065-46e6bc5cc3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:55.613012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bd5e3-9a8d-4518-b42d-34269080c3b1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:55.645215 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:55.651547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e561342-62f1-44d3-91a6-855089da67f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:55.652530 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e561342-62f1-44d3-91a6-855089da67f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.653060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e561342-62f1-44d3-91a6-855089da67f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.653335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e561342-62f1-44d3-91a6-855089da67f9 None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/85602a9d62bc475fb5da609f97958d5f/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.655996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e561342-62f1-44d3-91a6-855089da67f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=85602a9d62bc475fb5da609f97958d5f, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:55.657426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e561342-62f1-44d3-91a6-855089da67f9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:55.667481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 399/808] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:19:55.667481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9178319-6663-4daf-b065-46e6bc5cc3bb None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.681060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:55.684537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 410/809] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:19:55 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/85602a9d62bc475fb5da609f97958d5f/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:19:55.691940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e561342-62f1-44d3-91a6-855089da67f9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.820548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9178319-6663-4daf-b065-46e6bc5cc3bb None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:55.884420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec6bf-5d6b-4b44-958c-dabeda0f378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:55.885060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec6bf-5d6b-4b44-958c-dabeda0f378f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.885336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec6bf-5d6b-4b44-958c-dabeda0f378f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.885600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec6bf-5d6b-4b44-958c-dabeda0f378f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.901045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ec6bf-5d6b-4b44-958c-dabeda0f378f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:55.902678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ec6bf-5d6b-4b44-958c-dabeda0f378f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:55.906252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e561342-62f1-44d3-91a6-855089da67f9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-393ec6bf-5d6b-4b44-958c-dabeda0f378f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:55.921659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:55.922676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:55.923621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:55.923621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:55.923621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:55.923621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 400/810] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:55.929824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec6bf-5d6b-4b44-958c-dabeda0f378f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.949253 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d13b16-2dcc-4928-bd42-5fafcf99f9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:55.949888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d13b16-2dcc-4928-bd42-5fafcf99f9ba None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:55.950156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d13b16-2dcc-4928-bd42-5fafcf99f9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:55.950416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d13b16-2dcc-4928-bd42-5fafcf99f9ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:55.957615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d13b16-2dcc-4928-bd42-5fafcf99f9ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:55.959052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d13b16-2dcc-4928-bd42-5fafcf99f9ba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f2d13b16-2dcc-4928-bd42-5fafcf99f9ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:55.971786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:55.972715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:55.973630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:55.973630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:55.973630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:55.973630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:55.973630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:55.973630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:55.973630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:55.973630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:55.973630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 411/811] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:55.978485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d13b16-2dcc-4928-bd42-5fafcf99f9ba None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:55.986679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:56.040806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:56.067829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec6bf-5d6b-4b44-958c-dabeda0f378f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:56.084531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d13b16-2dcc-4928-bd42-5fafcf99f9ba None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:56.119626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ff12f-62ec-43fa-8975-cc949bb32f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:56.120238 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ff12f-62ec-43fa-8975-cc949bb32f39 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.120509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ff12f-62ec-43fa-8975-cc949bb32f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.120703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e306f-4cd4-4b65-a2d7-2ab467459dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:56.120819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ff12f-62ec-43fa-8975-cc949bb32f39 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.121446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ff12f-62ec-43fa-8975-cc949bb32f39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:56.121743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ff12f-62ec-43fa-8975-cc949bb32f39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:56.122067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e306f-4cd4-4b65-a2d7-2ab467459dea None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.122531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e306f-4cd4-4b65-a2d7-2ab467459dea None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.123047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e306f-4cd4-4b65-a2d7-2ab467459dea None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.123164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ff12f-62ec-43fa-8975-cc949bb32f39 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:56.124080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e306f-4cd4-4b65-a2d7-2ab467459dea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:56.124599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e306f-4cd4-4b65-a2d7-2ab467459dea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:56.127041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e306f-4cd4-4b65-a2d7-2ab467459dea None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:56.136691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 412/812] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:56.137627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ff12f-62ec-43fa-8975-cc949bb32f39 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:56.145539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 401/813] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:56.147229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e306f-4cd4-4b65-a2d7-2ab467459dea None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:56.239722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ff12f-62ec-43fa-8975-cc949bb32f39 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:56.261270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:56.277309 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4bba4-4ca0-4bc0-9d96-234bb704e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:56.278072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4bba4-4ca0-4bc0-9d96-234bb704e7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.278268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4bba4-4ca0-4bc0-9d96-234bb704e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.278525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4bba4-4ca0-4bc0-9d96-234bb704e7e5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.279114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4bba4-4ca0-4bc0-9d96-234bb704e7e5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:56.280897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4bba4-4ca0-4bc0-9d96-234bb704e7e5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:56.282960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:56.287069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e306f-4cd4-4b65-a2d7-2ab467459dea None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-14f4bba4-4ca0-4bc0-9d96-234bb704e7e5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:56.291690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:56.292681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:56.293526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 413/814] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Oct 6 04:19:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:56.294318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4bba4-4ca0-4bc0-9d96-234bb704e7e5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:56.349471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931138f0-a6c2-41d1-9cf7-bf6faaf16cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:56.350933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931138f0-a6c2-41d1-9cf7-bf6faaf16cf7 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.352092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931138f0-a6c2-41d1-9cf7-bf6faaf16cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.352603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931138f0-a6c2-41d1-9cf7-bf6faaf16cf7 None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/cdff0406366845169a481e3cd1188725/roles/b62720b095b548c38bc8740a29e49cb2` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.376657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931138f0-a6c2-41d1-9cf7-bf6faaf16cf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=cdff0406366845169a481e3cd1188725, role_id=b62720b095b548c38bc8740a29e49cb2)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:56.379906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931138f0-a6c2-41d1-9cf7-bf6faaf16cf7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:56.400655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 402/815] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:19:56 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/cdff0406366845169a481e3cd1188725/roles/b62720b095b548c38bc8740a29e49cb2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:19:56.402395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931138f0-a6c2-41d1-9cf7-bf6faaf16cf7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:56.415328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4bba4-4ca0-4bc0-9d96-234bb704e7e5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:56.463456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065482e-405d-4813-ac36-a3629fdf02a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:56.464853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065482e-405d-4813-ac36-a3629fdf02a6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.465353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065482e-405d-4813-ac36-a3629fdf02a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.465820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065482e-405d-4813-ac36-a3629fdf02a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.478596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065482e-405d-4813-ac36-a3629fdf02a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:56.480413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065482e-405d-4813-ac36-a3629fdf02a6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2065482e-405d-4813-ac36-a3629fdf02a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:56.495166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:56.496236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:56.497196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 414/816] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 6 04:19:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:56.498870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6a3bc-7b40-47d3-a0b5-f233b5a4a99d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.499363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6a3bc-7b40-47d3-a0b5-f233b5a4a99d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.499722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6a3bc-7b40-47d3-a0b5-f233b5a4a99d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.501583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 415/817] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:56.502362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6a3bc-7b40-47d3-a0b5-f233b5a4a99d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:56.538053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931138f0-a6c2-41d1-9cf7-bf6faaf16cf7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:56.557010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:56.592180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1ecf8-16bf-46ad-bab0-968b81c97a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:56.593033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1ecf8-16bf-46ad-bab0-968b81c97a5c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.593465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1ecf8-16bf-46ad-bab0-968b81c97a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.593803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1ecf8-16bf-46ad-bab0-968b81c97a5c None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.594578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1ecf8-16bf-46ad-bab0-968b81c97a5c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:56.594946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1ecf8-16bf-46ad-bab0-968b81c97a5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:56.597323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1ecf8-16bf-46ad-bab0-968b81c97a5c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:56.605176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 403/818] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 6 04:19:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:56.606885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329004e-3857-4a67-b63c-556c89e4b822 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.607278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329004e-3857-4a67-b63c-556c89e4b822 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.607661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329004e-3857-4a67-b63c-556c89e4b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.628868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6a3bc-7b40-47d3-a0b5-f233b5a4a99d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:56.634533 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3329004e-3857-4a67-b63c-556c89e4b822 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:56.635780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3329004e-3857-4a67-b63c-556c89e4b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:56.647961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:56.674325 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93fa4-82a6-4011-9b15-3f520041ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:56.674941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93fa4-82a6-4011-9b15-3f520041ff15 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.675407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93fa4-82a6-4011-9b15-3f520041ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.675622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93fa4-82a6-4011-9b15-3f520041ff15 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.676440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93fa4-82a6-4011-9b15-3f520041ff15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:56.676739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93fa4-82a6-4011-9b15-3f520041ff15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:56.678161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93fa4-82a6-4011-9b15-3f520041ff15 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:56.697900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 416/819] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 6 04:19:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:56.698739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93fa4-82a6-4011-9b15-3f520041ff15 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:56.720483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 404/820] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:19:56.721356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329004e-3857-4a67-b63c-556c89e4b822 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:56.805983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93fa4-82a6-4011-9b15-3f520041ff15 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:56.807902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:56.857603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53443-8d15-4146-baec-302c31bf9568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:56.858175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53443-8d15-4146-baec-302c31bf9568 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.858508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53443-8d15-4146-baec-302c31bf9568 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.858828 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53443-8d15-4146-baec-302c31bf9568 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.859519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53443-8d15-4146-baec-302c31bf9568 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:56.859819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53443-8d15-4146-baec-302c31bf9568 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:56.861189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53443-8d15-4146-baec-302c31bf9568 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:56.874718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 417/821] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Oct 6 04:19:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:56.880324 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53443-8d15-4146-baec-302c31bf9568 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:56.890031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329004e-3857-4a67-b63c-556c89e4b822 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:56.933828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc997a30-f36d-4061-af08-b39fc193de9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:56.935667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997a30-f36d-4061-af08-b39fc193de9c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:56.937655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997a30-f36d-4061-af08-b39fc193de9c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:56.938156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997a30-f36d-4061-af08-b39fc193de9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:56.970193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:57.073072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53443-8d15-4146-baec-302c31bf9568 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:57.080378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc997a30-f36d-4061-af08-b39fc193de9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:57.081849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc997a30-f36d-4061-af08-b39fc193de9c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:57.109771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d262077-7283-427f-bc25-e03df35877f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:57.110722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d262077-7283-427f-bc25-e03df35877f0 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:57.111292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d262077-7283-427f-bc25-e03df35877f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:57.111768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d262077-7283-427f-bc25-e03df35877f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:57.113122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d262077-7283-427f-bc25-e03df35877f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:57.114803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d262077-7283-427f-bc25-e03df35877f0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:57.141789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 418/822] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:19:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:19:57.143072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d262077-7283-427f-bc25-e03df35877f0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:57.175711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:57.221295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 405/823] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:19:57.226904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc997a30-f36d-4061-af08-b39fc193de9c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:57.279678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d262077-7283-427f-bc25-e03df35877f0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:57.322949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dca2a2-cd58-4841-aecc-c16d6b7893bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:57.324012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dca2a2-cd58-4841-aecc-c16d6b7893bc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:57.324514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dca2a2-cd58-4841-aecc-c16d6b7893bc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:57.324982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dca2a2-cd58-4841-aecc-c16d6b7893bc None admin] PATH_INFO: `/v3/services/network` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:57.325814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dca2a2-cd58-4841-aecc-c16d6b7893bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:57.327743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dca2a2-cd58-4841-aecc-c16d6b7893bc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:57.332134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-40dca2a2-cd58-4841-aecc-c16d6b7893bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:57.340729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:57.341795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 04:19:57.342787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:57.347664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 419/824] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:57 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:57.357337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dca2a2-cd58-4841-aecc-c16d6b7893bc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:57.427365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc997a30-f36d-4061-af08-b39fc193de9c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:57.465056 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990ba77-834f-4bf6-8e46-5605460d9904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:57.466181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990ba77-834f-4bf6-8e46-5605460d9904 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:57.466729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990ba77-834f-4bf6-8e46-5605460d9904 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:57.467235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990ba77-834f-4bf6-8e46-5605460d9904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:57.481944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990ba77-834f-4bf6-8e46-5605460d9904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:57.483982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990ba77-834f-4bf6-8e46-5605460d9904 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:57.499292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c990ba77-834f-4bf6-8e46-5605460d9904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:57.502756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:57.504465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:57.505729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:57.505729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:57.505729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:57.507138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 406/825] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:57.513901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990ba77-834f-4bf6-8e46-5605460d9904 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:57.520678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dca2a2-cd58-4841-aecc-c16d6b7893bc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:57.562977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ea839-f2d0-42e8-a3ff-6a86bda57c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:57.563872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ea839-f2d0-42e8-a3ff-6a86bda57c24 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:57.564292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ea839-f2d0-42e8-a3ff-6a86bda57c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:57.564726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ea839-f2d0-42e8-a3ff-6a86bda57c24 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:57.565551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ea839-f2d0-42e8-a3ff-6a86bda57c24 None admin] RBAC: Adding query filter params (name=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:57.566103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ea839-f2d0-42e8-a3ff-6a86bda57c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:57.567685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ea839-f2d0-42e8-a3ff-6a86bda57c24 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:57.573920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 420/826] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:19:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:57.580091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ea839-f2d0-42e8-a3ff-6a86bda57c24 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:57.625183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:57.630878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990ba77-834f-4bf6-8e46-5605460d9904 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:57.666668 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732cd01-53a4-4e7c-9aee-4fe0db357f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:57.667717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732cd01-53a4-4e7c-9aee-4fe0db357f4f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:57.667717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732cd01-53a4-4e7c-9aee-4fe0db357f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:57.668196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732cd01-53a4-4e7c-9aee-4fe0db357f4f None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:57.668936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732cd01-53a4-4e7c-9aee-4fe0db357f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:57.669334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732cd01-53a4-4e7c-9aee-4fe0db357f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:57.670993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732cd01-53a4-4e7c-9aee-4fe0db357f4f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:57.684216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 407/827] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:57.690007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732cd01-53a4-4e7c-9aee-4fe0db357f4f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:57.693646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ea839-f2d0-42e8-a3ff-6a86bda57c24 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:57.730486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173295aa-b92a-4531-bd58-77a1b97a9f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:57.731476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173295aa-b92a-4531-bd58-77a1b97a9f94 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:57.731945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173295aa-b92a-4531-bd58-77a1b97a9f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:57.732433 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173295aa-b92a-4531-bd58-77a1b97a9f94 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:57.733298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173295aa-b92a-4531-bd58-77a1b97a9f94 None admin] RBAC: Adding query filter params (type=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:57.734095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173295aa-b92a-4531-bd58-77a1b97a9f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:57.735756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173295aa-b92a-4531-bd58-77a1b97a9f94 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:57.742346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 421/828] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:19:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:57.748399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173295aa-b92a-4531-bd58-77a1b97a9f94 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:57.763149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:57.794025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732cd01-53a4-4e7c-9aee-4fe0db357f4f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:57.848619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e53708-16e2-45c6-905f-e5da5e1cceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:57.849270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e53708-16e2-45c6-905f-e5da5e1cceb8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:57.849547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e53708-16e2-45c6-905f-e5da5e1cceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:57.850140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e53708-16e2-45c6-905f-e5da5e1cceb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:57.862846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173295aa-b92a-4531-bd58-77a1b97a9f94 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:57.864634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e53708-16e2-45c6-905f-e5da5e1cceb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:57.866640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e53708-16e2-45c6-905f-e5da5e1cceb8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-53e53708-16e2-45c6-905f-e5da5e1cceb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:19:57.878036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:57.879179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:57.880406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:19:57.880406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:19:57.880406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:19:57.880406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:19:57.880406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:19:57.880406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:19:57.880406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:19:57.880406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:57.884341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 408/829] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:57.885713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e53708-16e2-45c6-905f-e5da5e1cceb8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:57.904471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472001a4-0fd9-4db3-8340-b0bc82112fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:57.905563 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472001a4-0fd9-4db3-8340-b0bc82112fd2 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:57.906200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472001a4-0fd9-4db3-8340-b0bc82112fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:57.906620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472001a4-0fd9-4db3-8340-b0bc82112fd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:57.907559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472001a4-0fd9-4db3-8340-b0bc82112fd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:57.909128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472001a4-0fd9-4db3-8340-b0bc82112fd2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:57.931774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 422/830] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:19:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:19:57.937042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:58.051431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e53708-16e2-45c6-905f-e5da5e1cceb8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:58.104938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe7e3d-0cd2-4b62-96f9-bd67b428d1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:58.105630 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe7e3d-0cd2-4b62-96f9-bd67b428d1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:58.105816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe7e3d-0cd2-4b62-96f9-bd67b428d1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:58.106085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe7e3d-0cd2-4b62-96f9-bd67b428d1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:58.106783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe7e3d-0cd2-4b62-96f9-bd67b428d1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:58.107082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe7e3d-0cd2-4b62-96f9-bd67b428d1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:58.108750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe7e3d-0cd2-4b62-96f9-bd67b428d1a3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:58.128169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 409/831] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:58.134403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472001a4-0fd9-4db3-8340-b0bc82112fd2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:58.207033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:58.248439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472001a4-0fd9-4db3-8340-b0bc82112fd2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:58.284483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ebf6-edf4-48f3-97fe-b99f36be8683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:58.285820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ebf6-edf4-48f3-97fe-b99f36be8683 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:58.286240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ebf6-edf4-48f3-97fe-b99f36be8683 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:58.286940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ebf6-edf4-48f3-97fe-b99f36be8683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:58.287856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ebf6-edf4-48f3-97fe-b99f36be8683 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=e6bea894013f40638404395075ade90d, user.id=0481d4c0be0b46189e339d1e00bee4c0) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:58.288321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ebf6-edf4-48f3-97fe-b99f36be8683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:58.289887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ebf6-edf4-48f3-97fe-b99f36be8683 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:58.296599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 423/832] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:19:58 2022] GET /identity/v3/role_assignments?user.id=0481d4c0be0b46189e339d1e00bee4c0&scope.project.id=e6bea894013f40638404395075ade90d&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:58.376500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ffb14-ac8c-457a-bc0a-8da07468ddfe None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:58.376829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ffb14-ac8c-457a-bc0a-8da07468ddfe None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:58.377039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ffb14-ac8c-457a-bc0a-8da07468ddfe None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:58.378712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 410/833] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:58.384637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36685d-b3bd-43d6-a10d-274c75a45691 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:58.384933 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36685d-b3bd-43d6-a10d-274c75a45691 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:58.385191 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36685d-b3bd-43d6-a10d-274c75a45691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:58.409483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7b36685d-b3bd-43d6-a10d-274c75a45691 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:58.410740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7b36685d-b3bd-43d6-a10d-274c75a45691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:58.498848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 424/834] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:19:58.766881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ffb14-ac8c-457a-bc0a-8da07468ddfe None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:58.849771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:58.882427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ffb14-ac8c-457a-bc0a-8da07468ddfe None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:58.918337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a434e-0d5c-4951-91c7-0bcc4b852f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:58.918978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a434e-0d5c-4951-91c7-0bcc4b852f94 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:58.919253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a434e-0d5c-4951-91c7-0bcc4b852f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:58.919549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a434e-0d5c-4951-91c7-0bcc4b852f94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:58.930489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a434e-0d5c-4951-91c7-0bcc4b852f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-229a434e-0d5c-4951-91c7-0bcc4b852f94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:58.935273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:58.936357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:58.937226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 411/835] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:58.942869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36685d-b3bd-43d6-a10d-274c75a45691 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:58.952871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431903a-6023-413f-a0b8-e2ec4b600949 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:58.953146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431903a-6023-413f-a0b8-e2ec4b600949 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:58.953408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431903a-6023-413f-a0b8-e2ec4b600949 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:58.954991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 412/836] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:19:58.960114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f164-37ee-4d0d-aeae-d6fd7496b524 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:58.960393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f164-37ee-4d0d-aeae-d6fd7496b524 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:58.960667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f164-37ee-4d0d-aeae-d6fd7496b524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:58.981863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a571f164-37ee-4d0d-aeae-d6fd7496b524 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:58.983113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a571f164-37ee-4d0d-aeae-d6fd7496b524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:59.031767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:59.047873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36685d-b3bd-43d6-a10d-274c75a45691 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:59.058556 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 413/837] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:19:59.084356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fc71c-5c9f-472b-867e-a52b9083aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:59.085033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc71c-5c9f-472b-867e-a52b9083aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:59.085312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc71c-5c9f-472b-867e-a52b9083aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:59.085585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc71c-5c9f-472b-867e-a52b9083aeb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:59.086301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fc71c-5c9f-472b-867e-a52b9083aeb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:59.086606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fc71c-5c9f-472b-867e-a52b9083aeb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:59.088008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fc71c-5c9f-472b-867e-a52b9083aeb5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:59.097784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 425/838] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:59.103609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571f164-37ee-4d0d-aeae-d6fd7496b524 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:59.169992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:59.208216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571f164-37ee-4d0d-aeae-d6fd7496b524 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:59.242354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367a4a1-bff0-49ca-892a-811cc56f98e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:59.242989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367a4a1-bff0-49ca-892a-811cc56f98e1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:59.243265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367a4a1-bff0-49ca-892a-811cc56f98e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:59.243559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367a4a1-bff0-49ca-892a-811cc56f98e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:59.254158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367a4a1-bff0-49ca-892a-811cc56f98e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:59.255694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367a4a1-bff0-49ca-892a-811cc56f98e1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a367a4a1-bff0-49ca-892a-811cc56f98e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:59.274811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:59.276816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:59.276816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:59.276816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:59.276816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 414/839] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:59.279327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fc71c-5c9f-472b-867e-a52b9083aeb5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:59.346107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367a4a1-bff0-49ca-892a-811cc56f98e1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:59.393937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fc71c-5c9f-472b-867e-a52b9083aeb5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:59.418194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:59.430676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7b4c-1580-48e7-a61d-a0f9d24fac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:59.431290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7b4c-1580-48e7-a61d-a0f9d24fac2f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:59.431927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7b4c-1580-48e7-a61d-a0f9d24fac2f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:59.432039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7b4c-1580-48e7-a61d-a0f9d24fac2f None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:59.432630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7b4c-1580-48e7-a61d-a0f9d24fac2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:59.432935 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7b4c-1580-48e7-a61d-a0f9d24fac2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:59.434397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7b4c-1580-48e7-a61d-a0f9d24fac2f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:59.452257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 426/840] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:59.453343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7b4c-1580-48e7-a61d-a0f9d24fac2f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:59.456973 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367a4a1-bff0-49ca-892a-811cc56f98e1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:59.471986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:59.494267 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd724aa4-ba3f-410a-b3be-7dedba8d0236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:59.494988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd724aa4-ba3f-410a-b3be-7dedba8d0236 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:59.495360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd724aa4-ba3f-410a-b3be-7dedba8d0236 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:59.495699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd724aa4-ba3f-410a-b3be-7dedba8d0236 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:59.506746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd724aa4-ba3f-410a-b3be-7dedba8d0236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-dd724aa4-ba3f-410a-b3be-7dedba8d0236 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:19:59.512475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:59.513612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:19:59.515096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:59.520718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 415/841] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:19:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:59.521779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd724aa4-ba3f-410a-b3be-7dedba8d0236 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:59.567928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7b4c-1580-48e7-a61d-a0f9d24fac2f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:59.606092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7591c7-b300-4bdd-a652-806fd9bb8139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:59.607135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7591c7-b300-4bdd-a652-806fd9bb8139 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:59.607581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7591c7-b300-4bdd-a652-806fd9bb8139 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:59.608115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7591c7-b300-4bdd-a652-806fd9bb8139 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:59.618254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7591c7-b300-4bdd-a652-806fd9bb8139 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:59.620610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7591c7-b300-4bdd-a652-806fd9bb8139 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:59.628019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd724aa4-ba3f-410a-b3be-7dedba8d0236 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2b7591c7-b300-4bdd-a652-806fd9bb8139 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:19:59.636264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:59.637278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:19:59.638239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 427/842] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:19:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:19:59.645325 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7591c7-b300-4bdd-a652-806fd9bb8139 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:59.672857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811751cc-0205-49e3-a23e-1e8e435033cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:59.673656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811751cc-0205-49e3-a23e-1e8e435033cb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:59.673935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811751cc-0205-49e3-a23e-1e8e435033cb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:59.674221 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811751cc-0205-49e3-a23e-1e8e435033cb None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:59.674895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811751cc-0205-49e3-a23e-1e8e435033cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:59.675199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811751cc-0205-49e3-a23e-1e8e435033cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:59.676681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811751cc-0205-49e3-a23e-1e8e435033cb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:59.691894 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 416/843] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:19:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:19:59.692950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811751cc-0205-49e3-a23e-1e8e435033cb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:59.709009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:59.738690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:59.793694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7591c7-b300-4bdd-a652-806fd9bb8139 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:59.805675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811751cc-0205-49e3-a23e-1e8e435033cb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:59.831567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478402f-c4db-4ebb-b151-5a0a8156c288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:59.832180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478402f-c4db-4ebb-b151-5a0a8156c288 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:59.832452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478402f-c4db-4ebb-b151-5a0a8156c288 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:59.832714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478402f-c4db-4ebb-b151-5a0a8156c288 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:59.833443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478402f-c4db-4ebb-b151-5a0a8156c288 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:19:59.833981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478402f-c4db-4ebb-b151-5a0a8156c288 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:59.835150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478402f-c4db-4ebb-b151-5a0a8156c288 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:59.841802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b167ea3-8e00-4322-86d0-87e16f181db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:19:59.842495 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b167ea3-8e00-4322-86d0-87e16f181db5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:59.842772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b167ea3-8e00-4322-86d0-87e16f181db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:59.843040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b167ea3-8e00-4322-86d0-87e16f181db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:59.852606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 428/844] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Oct 6 04:19:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:19:59.853619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4374e-d2f5-4a40-bef9-02e72fd4031e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:59.853949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4374e-d2f5-4a40-bef9-02e72fd4031e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:59.854223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4374e-d2f5-4a40-bef9-02e72fd4031e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:59.855558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 429/845] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:19:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:19:59.858304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4374e-d2f5-4a40-bef9-02e72fd4031e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:59.858512 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b167ea3-8e00-4322-86d0-87e16f181db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:19:59.860072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b167ea3-8e00-4322-86d0-87e16f181db5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-5b167ea3-8e00-4322-86d0-87e16f181db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:19:59.877008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:19:59.878041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:19:59.878941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:19:59.878941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:19:59.878941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:19:59.882873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 417/846] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:19:59.884127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7330a-ba3b-43fe-b41e-63a246b58877 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:19:59.884406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7330a-ba3b-43fe-b41e-63a246b58877 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:19:59.884674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7330a-ba3b-43fe-b41e-63a246b58877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:19:59.902229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4fd7330a-ba3b-43fe-b41e-63a246b58877 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:19:59.903430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4fd7330a-ba3b-43fe-b41e-63a246b58877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:19:59.966508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:19:59.971802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4374e-d2f5-4a40-bef9-02e72fd4031e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:19:59.975421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 418/847] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:19:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:19:59.975912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7330a-ba3b-43fe-b41e-63a246b58877 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:19:59.997503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:00.027676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193b81e-d29b-4184-81e6-a939cd1c3e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:00.028599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b81e-d29b-4184-81e6-a939cd1c3e2b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.029051 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b81e-d29b-4184-81e6-a939cd1c3e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.030039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b81e-d29b-4184-81e6-a939cd1c3e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.094913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7330a-ba3b-43fe-b41e-63a246b58877 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:00.106507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b81e-d29b-4184-81e6-a939cd1c3e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:00.108393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b81e-d29b-4184-81e6-a939cd1c3e2b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:00.138966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa9cee-bc78-470e-9e1b-a5f6dc57fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:00.140120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa9cee-bc78-470e-9e1b-a5f6dc57fdba None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.140459 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa9cee-bc78-470e-9e1b-a5f6dc57fdba None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.140790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa9cee-bc78-470e-9e1b-a5f6dc57fdba None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.141730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa9cee-bc78-470e-9e1b-a5f6dc57fdba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:00.142087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa9cee-bc78-470e-9e1b-a5f6dc57fdba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:00.144230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa9cee-bc78-470e-9e1b-a5f6dc57fdba None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:00.163364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 419/848] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:00.166202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa9cee-bc78-470e-9e1b-a5f6dc57fdba None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:00.221139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:00.225523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 430/849] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:19:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:20:00.230726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193b81e-d29b-4184-81e6-a939cd1c3e2b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:00.271010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:00.295205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa9cee-bc78-470e-9e1b-a5f6dc57fdba None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:00.334315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193b81e-d29b-4184-81e6-a939cd1c3e2b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:00.334609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fde21-f83a-4107-9c59-fd740982d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:00.335244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fde21-f83a-4107-9c59-fd740982d87a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.335568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fde21-f83a-4107-9c59-fd740982d87a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.335837 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fde21-f83a-4107-9c59-fd740982d87a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.344198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fde21-f83a-4107-9c59-fd740982d87a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:00.345779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fde21-f83a-4107-9c59-fd740982d87a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a13fde21-f83a-4107-9c59-fd740982d87a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:20:00.357327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:00.358391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 420/850] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 6 04:20:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:00.359520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fde21-f83a-4107-9c59-fd740982d87a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:00.379568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2df004-9075-4690-8a46-fd0ccd1d9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:00.380348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2df004-9075-4690-8a46-fd0ccd1d9db2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.380594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2df004-9075-4690-8a46-fd0ccd1d9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.380860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2df004-9075-4690-8a46-fd0ccd1d9db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.392946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2df004-9075-4690-8a46-fd0ccd1d9db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:00.394625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2df004-9075-4690-8a46-fd0ccd1d9db2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6a2df004-9075-4690-8a46-fd0ccd1d9db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:00.413781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:00.414917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:00.421268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:00.421268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:00.421268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:00.421268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 431/851] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:00.421268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2df004-9075-4690-8a46-fd0ccd1d9db2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:00.474855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fde21-f83a-4107-9c59-fd740982d87a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:00.476301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:00.510901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40a3ff-7e25-449b-aa63-350ed4603de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:00.511571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40a3ff-7e25-449b-aa63-350ed4603de8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.511850 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40a3ff-7e25-449b-aa63-350ed4603de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.512118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40a3ff-7e25-449b-aa63-350ed4603de8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.512696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40a3ff-7e25-449b-aa63-350ed4603de8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:00.514083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40a3ff-7e25-449b-aa63-350ed4603de8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6f40a3ff-7e25-449b-aa63-350ed4603de8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:00.523416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:00.524470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:00.525354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 421/852] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:20:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:00.526167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40a3ff-7e25-449b-aa63-350ed4603de8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:00.530188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:00.531508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2df004-9075-4690-8a46-fd0ccd1d9db2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:00.564904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bd054-145a-488b-a8f4-bb14ca7841c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:00.565512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bd054-145a-488b-a8f4-bb14ca7841c8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.565785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bd054-145a-488b-a8f4-bb14ca7841c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.566052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bd054-145a-488b-a8f4-bb14ca7841c8 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.566779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bd054-145a-488b-a8f4-bb14ca7841c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:00.567077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bd054-145a-488b-a8f4-bb14ca7841c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:00.568539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bd054-145a-488b-a8f4-bb14ca7841c8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:00.585544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 432/853] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Oct 6 04:20:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:00.587462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79e03d-fe85-4441-97d6-8ed2f6ce6b6b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.587823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79e03d-fe85-4441-97d6-8ed2f6ce6b6b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.588065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79e03d-fe85-4441-97d6-8ed2f6ce6b6b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.591342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 433/854] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:00.591342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79e03d-fe85-4441-97d6-8ed2f6ce6b6b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:00.629434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40a3ff-7e25-449b-aa63-350ed4603de8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:00.661609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b672365-9b2d-47ce-a1a8-e7056762ea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:00.662209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672365-9b2d-47ce-a1a8-e7056762ea8b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.662482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672365-9b2d-47ce-a1a8-e7056762ea8b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.662772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672365-9b2d-47ce-a1a8-e7056762ea8b None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.663447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b672365-9b2d-47ce-a1a8-e7056762ea8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:00.663743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b672365-9b2d-47ce-a1a8-e7056762ea8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:00.665109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b672365-9b2d-47ce-a1a8-e7056762ea8b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:00.676064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 422/855] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:00.676853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b672365-9b2d-47ce-a1a8-e7056762ea8b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:00.691903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79e03d-fe85-4441-97d6-8ed2f6ce6b6b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:00.702757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:00.725315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7047375-6c33-4dc4-8ee8-d0b9d2cb41ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:00.725918 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7047375-6c33-4dc4-8ee8-d0b9d2cb41ed None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.726190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7047375-6c33-4dc4-8ee8-d0b9d2cb41ed None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.726457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7047375-6c33-4dc4-8ee8-d0b9d2cb41ed None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.727078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7047375-6c33-4dc4-8ee8-d0b9d2cb41ed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:00.727398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7047375-6c33-4dc4-8ee8-d0b9d2cb41ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:00.728760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7047375-6c33-4dc4-8ee8-d0b9d2cb41ed None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:00.733046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 434/856] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:20:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:00.734207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06d34a-f086-471e-a042-8cb130697473 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.734492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06d34a-f086-471e-a042-8cb130697473 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.734758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06d34a-f086-471e-a042-8cb130697473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.739950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:00.753185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ac06d34a-f086-471e-a042-8cb130697473 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:00.754406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ac06d34a-f086-471e-a042-8cb130697473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:00.778834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b672365-9b2d-47ce-a1a8-e7056762ea8b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:00.813015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543223f5-e088-4376-9ce9-af250421d467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:00.813632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543223f5-e088-4376-9ce9-af250421d467 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.813912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543223f5-e088-4376-9ce9-af250421d467 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.814181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543223f5-e088-4376-9ce9-af250421d467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.824691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 435/857] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:00.825579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06d34a-f086-471e-a042-8cb130697473 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:00.884331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543223f5-e088-4376-9ce9-af250421d467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:00.885709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543223f5-e088-4376-9ce9-af250421d467 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:00.937221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06d34a-f086-471e-a042-8cb130697473 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:00.940382 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:00.949505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:00.978258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f54e1e-c1d1-49f0-b180-f34dd4b1dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:00.978917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f54e1e-c1d1-49f0-b180-f34dd4b1dc9b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:00.979191 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f54e1e-c1d1-49f0-b180-f34dd4b1dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:00.979612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f54e1e-c1d1-49f0-b180-f34dd4b1dc9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:00.986631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f54e1e-c1d1-49f0-b180-f34dd4b1dc9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:00.988108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f54e1e-c1d1-49f0-b180-f34dd4b1dc9b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:00.996914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 423/858] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:20:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:20:00.997662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543223f5-e088-4376-9ce9-af250421d467 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f0f54e1e-c1d1-49f0-b180-f34dd4b1dc9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:20:01.004688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:01.005610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:01.006542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:20:01.006542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:20:01.006542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:20:01.006542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:20:01.006542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:20:01.006542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:20:01.006542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:01.006542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:01.006542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 436/859] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:01.007542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f54e1e-c1d1-49f0-b180-f34dd4b1dc9b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:01.101511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543223f5-e088-4376-9ce9-af250421d467 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:01.112962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f54e1e-c1d1-49f0-b180-f34dd4b1dc9b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:01.135658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef7d02-3312-44ac-8218-c26b4fc5498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:01.136197 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef7d02-3312-44ac-8218-c26b4fc5498d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:01.136465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef7d02-3312-44ac-8218-c26b4fc5498d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:01.136733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef7d02-3312-44ac-8218-c26b4fc5498d None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:01.137355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef7d02-3312-44ac-8218-c26b4fc5498d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:01.137651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef7d02-3312-44ac-8218-c26b4fc5498d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:01.139017 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef7d02-3312-44ac-8218-c26b4fc5498d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:01.143362 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 424/860] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:20:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:01.144121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef7d02-3312-44ac-8218-c26b4fc5498d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:01.156807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714701f-3ed7-4aa7-8340-15e2097b7adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:01.157588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714701f-3ed7-4aa7-8340-15e2097b7adc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:01.157864 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714701f-3ed7-4aa7-8340-15e2097b7adc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:01.158197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714701f-3ed7-4aa7-8340-15e2097b7adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:01.171583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714701f-3ed7-4aa7-8340-15e2097b7adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:01.173026 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714701f-3ed7-4aa7-8340-15e2097b7adc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:01.174725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e714701f-3ed7-4aa7-8340-15e2097b7adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:01.191206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:01.192481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:01.193796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:01.193796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:01.193796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:01.195707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 437/861] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:01.196698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714701f-3ed7-4aa7-8340-15e2097b7adc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:01.220105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:01.271290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef7d02-3312-44ac-8218-c26b4fc5498d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:01.311290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288fa4-eabc-47e5-ade0-aff68d3f78c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:01.312921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288fa4-eabc-47e5-ade0-aff68d3f78c0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:01.313467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288fa4-eabc-47e5-ade0-aff68d3f78c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:01.313746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288fa4-eabc-47e5-ade0-aff68d3f78c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:01.314695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab288fa4-eabc-47e5-ade0-aff68d3f78c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:01.315015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab288fa4-eabc-47e5-ade0-aff68d3f78c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:01.318925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab288fa4-eabc-47e5-ade0-aff68d3f78c0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:01.319114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714701f-3ed7-4aa7-8340-15e2097b7adc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:01.333124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 425/862] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:01.333323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288fa4-eabc-47e5-ade0-aff68d3f78c0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:01.361421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca08622-0003-45c7-9112-36ccf2b7edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:01.362058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca08622-0003-45c7-9112-36ccf2b7edaf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:01.362344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca08622-0003-45c7-9112-36ccf2b7edaf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:01.362601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca08622-0003-45c7-9112-36ccf2b7edaf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:01.363187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca08622-0003-45c7-9112-36ccf2b7edaf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:01.364609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca08622-0003-45c7-9112-36ccf2b7edaf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-eca08622-0003-45c7-9112-36ccf2b7edaf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:01.374716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:01.375683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:01.376584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 438/863] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Oct 6 04:20:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:01.377376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca08622-0003-45c7-9112-36ccf2b7edaf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:01.425826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:01.441545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288fa4-eabc-47e5-ade0-aff68d3f78c0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:01.465360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:01.480357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419df41-dcb7-4849-a8eb-aff22d6b117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:01.480995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419df41-dcb7-4849-a8eb-aff22d6b117d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:01.481272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419df41-dcb7-4849-a8eb-aff22d6b117d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:01.481540 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419df41-dcb7-4849-a8eb-aff22d6b117d None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:01.482291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419df41-dcb7-4849-a8eb-aff22d6b117d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:01.482588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419df41-dcb7-4849-a8eb-aff22d6b117d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:01.484446 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419df41-dcb7-4849-a8eb-aff22d6b117d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:01.485906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca08622-0003-45c7-9112-36ccf2b7edaf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:01.501675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 426/864] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:01.502801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419df41-dcb7-4849-a8eb-aff22d6b117d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:01.519991 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd29a6-85d3-4288-99c9-aec928467569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:01.520614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd29a6-85d3-4288-99c9-aec928467569 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:01.520892 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd29a6-85d3-4288-99c9-aec928467569 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:01.521163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd29a6-85d3-4288-99c9-aec928467569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:01.521896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd29a6-85d3-4288-99c9-aec928467569 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=e6bea894013f40638404395075ade90d, user.id=85602a9d62bc475fb5da609f97958d5f) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:01.522205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd29a6-85d3-4288-99c9-aec928467569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:01.523682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd29a6-85d3-4288-99c9-aec928467569 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:01.529921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 439/865] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:20:01 2022] GET /identity/v3/role_assignments?user.id=85602a9d62bc475fb5da609f97958d5f&scope.project.id=e6bea894013f40638404395075ade90d&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:01.530722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd29a6-85d3-4288-99c9-aec928467569 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:01.626538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419df41-dcb7-4849-a8eb-aff22d6b117d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:01.664148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd29a6-85d3-4288-99c9-aec928467569 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:01.664463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae205b9-bc47-4e55-b4a3-440518d5a404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:01.665100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae205b9-bc47-4e55-b4a3-440518d5a404 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:01.665373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae205b9-bc47-4e55-b4a3-440518d5a404 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:01.665649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae205b9-bc47-4e55-b4a3-440518d5a404 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:01.666360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae205b9-bc47-4e55-b4a3-440518d5a404 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:01.666681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae205b9-bc47-4e55-b4a3-440518d5a404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:01.675336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae205b9-bc47-4e55-b4a3-440518d5a404 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:01.677325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 427/866] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:01.684286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae205b9-bc47-4e55-b4a3-440518d5a404 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:01.722141 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc94756-53cb-4af5-a481-6a1ab403f6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:01.723082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc94756-53cb-4af5-a481-6a1ab403f6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:01.723402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc94756-53cb-4af5-a481-6a1ab403f6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:01.723748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc94756-53cb-4af5-a481-6a1ab403f6a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:01.732671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc94756-53cb-4af5-a481-6a1ab403f6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:01.734376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc94756-53cb-4af5-a481-6a1ab403f6a4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:01.748443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-bcc94756-53cb-4af5-a481-6a1ab403f6a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:20:01.750166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:01.751034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:01.752010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:20:01.752010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:20:01.752010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:20:01.752010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:20:01.752010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:20:01.752010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:20:01.752010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:01.752010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:01.752438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 440/867] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:01.759944 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc94756-53cb-4af5-a481-6a1ab403f6a4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:01.765167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:01.813171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae205b9-bc47-4e55-b4a3-440518d5a404 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:01.848297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0e89e-51cf-4211-8538-6b6b803e41a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:01.849294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e89e-51cf-4211-8538-6b6b803e41a3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:01.849794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e89e-51cf-4211-8538-6b6b803e41a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:01.850295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e89e-51cf-4211-8538-6b6b803e41a3 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:01.851124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0e89e-51cf-4211-8538-6b6b803e41a3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:01.851664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0e89e-51cf-4211-8538-6b6b803e41a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:01.853239 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0e89e-51cf-4211-8538-6b6b803e41a3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:01.858688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 428/868] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:01.888600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc94756-53cb-4af5-a481-6a1ab403f6a4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:01.931062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b4c47-2eba-4710-88b1-683625dadd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:01.931643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b4c47-2eba-4710-88b1-683625dadd6f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:01.931924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b4c47-2eba-4710-88b1-683625dadd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:01.932187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b4c47-2eba-4710-88b1-683625dadd6f None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:01.932919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b4c47-2eba-4710-88b1-683625dadd6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:01.933219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b4c47-2eba-4710-88b1-683625dadd6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:01.934689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b4c47-2eba-4710-88b1-683625dadd6f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:01.949607 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 441/869] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:01.956983 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0e89e-51cf-4211-8538-6b6b803e41a3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:02.051837 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:02.082612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0e89e-51cf-4211-8538-6b6b803e41a3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:02.118241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec313d-ed0c-4ccc-832a-1bd89f351fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:02.118861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec313d-ed0c-4ccc-832a-1bd89f351fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:02.119137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec313d-ed0c-4ccc-832a-1bd89f351fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:02.119434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec313d-ed0c-4ccc-832a-1bd89f351fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:02.120176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec313d-ed0c-4ccc-832a-1bd89f351fd6 None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=cdff0406366845169a481e3cd1188725) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:02.120485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec313d-ed0c-4ccc-832a-1bd89f351fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:02.121923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec313d-ed0c-4ccc-832a-1bd89f351fd6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:02.129222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 429/870] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:20:01 2022] GET /identity/v3/role_assignments?user.id=cdff0406366845169a481e3cd1188725&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:03.351935 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fc006-e09d-4cac-be17-c5f079103e13 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:03.352515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fc006-e09d-4cac-be17-c5f079103e13 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:03.352515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fc006-e09d-4cac-be17-c5f079103e13 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:03.354057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 442/871] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:03.359262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d3375-f223-4c01-a9c7-a9b834eebed0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:03.359700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d3375-f223-4c01-a9c7-a9b834eebed0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:03.359875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d3375-f223-4c01-a9c7-a9b834eebed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:03.378684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cb2d3375-f223-4c01-a9c7-a9b834eebed0 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:03.379889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cb2d3375-f223-4c01-a9c7-a9b834eebed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:03.449302 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 430/872] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:03.715253 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fc006-e09d-4cac-be17-c5f079103e13 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:03.785503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:03.824561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fc006-e09d-4cac-be17-c5f079103e13 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:03.859507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a369df9-dfd7-4c44-93ce-6dfd6eb1daf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:03.860189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369df9-dfd7-4c44-93ce-6dfd6eb1daf0 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:03.860468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369df9-dfd7-4c44-93ce-6dfd6eb1daf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:03.860737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369df9-dfd7-4c44-93ce-6dfd6eb1daf0 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:03.861410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a369df9-dfd7-4c44-93ce-6dfd6eb1daf0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:03.862682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc02da-12d3-47f6-b62d-86c1143a01ee None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:03.862806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a369df9-dfd7-4c44-93ce-6dfd6eb1daf0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:03.862975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc02da-12d3-47f6-b62d-86c1143a01ee None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:03.863225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc02da-12d3-47f6-b62d-86c1143a01ee None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:03.864912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 431/873] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:20:03.870482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad14bc-4177-4ddd-af7e-b65d43a76fa3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:03.870798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad14bc-4177-4ddd-af7e-b65d43a76fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:03.871134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad14bc-4177-4ddd-af7e-b65d43a76fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:03.885259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 443/874] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:20:03 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:20:03.892764 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0dad14bc-4177-4ddd-af7e-b65d43a76fa3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:03.894000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0dad14bc-4177-4ddd-af7e-b65d43a76fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:03.963338 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:03.976449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 432/875] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:20:04.180736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f526bc-6cbe-43b1-a817-4e0c369023c0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:04.181084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f526bc-6cbe-43b1-a817-4e0c369023c0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:04.181350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f526bc-6cbe-43b1-a817-4e0c369023c0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:04.182994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 444/876] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:04.188870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03178189-c004-455a-9654-c4f6e93b0383 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:04.189158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03178189-c004-455a-9654-c4f6e93b0383 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:04.189428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03178189-c004-455a-9654-c4f6e93b0383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:04.208978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-03178189-c004-455a-9654-c4f6e93b0383 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:04.210179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-03178189-c004-455a-9654-c4f6e93b0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:04.255829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f526bc-6cbe-43b1-a817-4e0c369023c0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:04.289684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 433/877] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:04.380540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f526bc-6cbe-43b1-a817-4e0c369023c0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:04.411374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:04.417087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b4c1e-8c81-43ef-b226-84d48f9972fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:04.417743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b4c1e-8c81-43ef-b226-84d48f9972fe None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:04.418021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b4c1e-8c81-43ef-b226-84d48f9972fe None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:04.418290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b4c1e-8c81-43ef-b226-84d48f9972fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:04.418883 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b4c1e-8c81-43ef-b226-84d48f9972fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:04.420309 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b4c1e-8c81-43ef-b226-84d48f9972fe None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:04.428855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3958-3da0-42f1-aa42-1fa1f5f540d8 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:04.429348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3958-3da0-42f1-aa42-1fa1f5f540d8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:04.429431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3958-3da0-42f1-aa42-1fa1f5f540d8 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-641b4c1e-8c81-43ef-b226-84d48f9972fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:04.430280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:04.431339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:04.432265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:04.433066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 434/878] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:04.433142 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 445/879] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:04.436017 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793ace-13c5-454a-8e46-1ad47bed714d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:04.436442 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793ace-13c5-454a-8e46-1ad47bed714d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:04.436657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793ace-13c5-454a-8e46-1ad47bed714d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:04.440326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b4c1e-8c81-43ef-b226-84d48f9972fe None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:04.455399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8e793ace-13c5-454a-8e46-1ad47bed714d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:04.456594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8e793ace-13c5-454a-8e46-1ad47bed714d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:04.545137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 435/880] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:04.565209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b4c1e-8c81-43ef-b226-84d48f9972fe None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:04.570458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e793ace-13c5-454a-8e46-1ad47bed714d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:04.602544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd465e1-ac84-4ba4-a7ab-e697ca967291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:04.603587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd465e1-ac84-4ba4-a7ab-e697ca967291 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:04.604589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd465e1-ac84-4ba4-a7ab-e697ca967291 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:04.604862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd465e1-ac84-4ba4-a7ab-e697ca967291 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:04.605494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd465e1-ac84-4ba4-a7ab-e697ca967291 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:04.605793 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd465e1-ac84-4ba4-a7ab-e697ca967291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:04.607149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd465e1-ac84-4ba4-a7ab-e697ca967291 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:04.612578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 446/881] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 6 04:20:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:04.619381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd465e1-ac84-4ba4-a7ab-e697ca967291 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:04.643273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:04.690334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:04.693488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e793ace-13c5-454a-8e46-1ad47bed714d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:04.728722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba8288-bdd2-4344-9aa1-f6abf5b82b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:04.729340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba8288-bdd2-4344-9aa1-f6abf5b82b55 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:04.729604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba8288-bdd2-4344-9aa1-f6abf5b82b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:04.729866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba8288-bdd2-4344-9aa1-f6abf5b82b55 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:04.730525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba8288-bdd2-4344-9aa1-f6abf5b82b55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:04.731929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba8288-bdd2-4344-9aa1-f6abf5b82b55 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:04.753269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd465e1-ac84-4ba4-a7ab-e697ca967291 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:04.759479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 436/882] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:20:04 2022] POST /identity/v3/services => generated 269 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:20:04.801591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7548e8c-9e2d-4de4-ad2a-3289bdea4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:04.802122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7548e8c-9e2d-4de4-ad2a-3289bdea4462 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:04.802399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7548e8c-9e2d-4de4-ad2a-3289bdea4462 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:04.802665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7548e8c-9e2d-4de4-ad2a-3289bdea4462 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:04.803300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7548e8c-9e2d-4de4-ad2a-3289bdea4462 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:04.803910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7548e8c-9e2d-4de4-ad2a-3289bdea4462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:04.805369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7548e8c-9e2d-4de4-ad2a-3289bdea4462 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:04.811157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 447/883] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 6 04:20:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:04.835994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba8288-bdd2-4344-9aa1-f6abf5b82b55 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:04.975621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba8288-bdd2-4344-9aa1-f6abf5b82b55 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:04.992833 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:05.016746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64dbb2-e3ec-4464-9960-c519212d0bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:05.017469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64dbb2-e3ec-4464-9960-c519212d0bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:05.017748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64dbb2-e3ec-4464-9960-c519212d0bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:05.018016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64dbb2-e3ec-4464-9960-c519212d0bb7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:05.031510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64dbb2-e3ec-4464-9960-c519212d0bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ea64dbb2-e3ec-4464-9960-c519212d0bb7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:20:05.037144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:05.038100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:05.039575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 437/884] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 6 04:20:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:05.044544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7548e8c-9e2d-4de4-ad2a-3289bdea4462 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:05.155288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7548e8c-9e2d-4de4-ad2a-3289bdea4462 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:05.169290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:05.196384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8ec75-7054-44c2-b10c-d03d372e7920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:05.197394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8ec75-7054-44c2-b10c-d03d372e7920 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:05.197882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8ec75-7054-44c2-b10c-d03d372e7920 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:05.198350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8ec75-7054-44c2-b10c-d03d372e7920 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:05.199200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8ec75-7054-44c2-b10c-d03d372e7920 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:05.199750 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8ec75-7054-44c2-b10c-d03d372e7920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:05.201357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8ec75-7054-44c2-b10c-d03d372e7920 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:05.210679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 448/885] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 6 04:20:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:05.216061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64dbb2-e3ec-4464-9960-c519212d0bb7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:05.320782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64dbb2-e3ec-4464-9960-c519212d0bb7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:05.355246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4a9af-1161-4a73-adf1-3a92cd13a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:05.355959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4a9af-1161-4a73-adf1-3a92cd13a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:05.356235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4a9af-1161-4a73-adf1-3a92cd13a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:05.356503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4a9af-1161-4a73-adf1-3a92cd13a6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:05.367974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4a9af-1161-4a73-adf1-3a92cd13a6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:05.369437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4a9af-1161-4a73-adf1-3a92cd13a6d2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ada4a9af-1161-4a73-adf1-3a92cd13a6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:05.388203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:05.389292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:05.390804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:05.390804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:05.390804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:05.390804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 438/886] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:05.395786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8ec75-7054-44c2-b10c-d03d372e7920 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:05.497344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8ec75-7054-44c2-b10c-d03d372e7920 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:05.531618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974734b-f039-4be1-959e-31b83eeba631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:05.532225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974734b-f039-4be1-959e-31b83eeba631 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:05.532498 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974734b-f039-4be1-959e-31b83eeba631 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:05.532762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974734b-f039-4be1-959e-31b83eeba631 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:05.533404 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974734b-f039-4be1-959e-31b83eeba631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:05.533698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974734b-f039-4be1-959e-31b83eeba631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:05.535052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974734b-f039-4be1-959e-31b83eeba631 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:05.547621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 449/887] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:05.552908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4a9af-1161-4a73-adf1-3a92cd13a6d2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:05.582945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:05.660382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4a9af-1161-4a73-adf1-3a92cd13a6d2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:05.695070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c6bf6-f9ac-493d-bead-3514e5570d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:05.695733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c6bf6-f9ac-493d-bead-3514e5570d72 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:05.696006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c6bf6-f9ac-493d-bead-3514e5570d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:05.696272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c6bf6-f9ac-493d-bead-3514e5570d72 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:05.704069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c6bf6-f9ac-493d-bead-3514e5570d72 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:05.705515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c6bf6-f9ac-493d-bead-3514e5570d72 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a41c6bf6-f9ac-493d-bead-3514e5570d72 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:20:05.717008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:05.718141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:05.719161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 439/888] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 6 04:20:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:05.726091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974734b-f039-4be1-959e-31b83eeba631 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:05.765072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:05.831666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974734b-f039-4be1-959e-31b83eeba631 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:05.868385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023287b-1208-4294-b55f-8aec4f2ba978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:05.869053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023287b-1208-4294-b55f-8aec4f2ba978 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:05.869330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023287b-1208-4294-b55f-8aec4f2ba978 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:05.869596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023287b-1208-4294-b55f-8aec4f2ba978 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:05.870326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023287b-1208-4294-b55f-8aec4f2ba978 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:05.870624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023287b-1208-4294-b55f-8aec4f2ba978 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:05.872074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023287b-1208-4294-b55f-8aec4f2ba978 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:05.889517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 450/889] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Oct 6 04:20:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:05.896392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c6bf6-f9ac-493d-bead-3514e5570d72 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:05.984140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:06.002571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c6bf6-f9ac-493d-bead-3514e5570d72 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:06.039641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0753-bd69-4513-bb3c-9962a3c414a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:06.040653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0753-bd69-4513-bb3c-9962a3c414a0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:06.041132 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0753-bd69-4513-bb3c-9962a3c414a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:06.041598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0753-bd69-4513-bb3c-9962a3c414a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:06.115604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0753-bd69-4513-bb3c-9962a3c414a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:06.117433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0753-bd69-4513-bb3c-9962a3c414a0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:06.121667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc940f-f9af-4d1f-a39a-5c0d870513b1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:06.121956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc940f-f9af-4d1f-a39a-5c0d870513b1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:06.122231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc940f-f9af-4d1f-a39a-5c0d870513b1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:06.123900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 451/890] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:06.129304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d878bc0-39e2-4152-be59-2df80bbd7e9a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:06.129650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d878bc0-39e2-4152-be59-2df80bbd7e9a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:06.129895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d878bc0-39e2-4152-be59-2df80bbd7e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:06.150589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5d878bc0-39e2-4152-be59-2df80bbd7e9a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:06.151828 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d878bc0-39e2-4152-be59-2df80bbd7e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:06.215861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:06.227394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 452/891] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:20:06.242803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 440/892] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:20:05 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:20:06.248961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d878bc0-39e2-4152-be59-2df80bbd7e9a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:06.275662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:06.360751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d878bc0-39e2-4152-be59-2df80bbd7e9a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:06.395084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2b47-a6b3-44de-8cde-4f9ebbb50e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:06.395751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2b47-a6b3-44de-8cde-4f9ebbb50e9d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:06.396026 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2b47-a6b3-44de-8cde-4f9ebbb50e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:06.396556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2b47-a6b3-44de-8cde-4f9ebbb50e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:06.406358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc2b47-a6b3-44de-8cde-4f9ebbb50e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:06.407836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc2b47-a6b3-44de-8cde-4f9ebbb50e9d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-84cc2b47-a6b3-44de-8cde-4f9ebbb50e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:06.422495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:06.423436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:06.424341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:06.424341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:06.424341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:06.424341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 453/893] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:06.429657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0753-bd69-4513-bb3c-9962a3c414a0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:06.492451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2b47-a6b3-44de-8cde-4f9ebbb50e9d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:06.546589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0753-bd69-4513-bb3c-9962a3c414a0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:06.569988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:06.595670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d295123-fe8e-4ea7-925f-1d024afbca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:06.596393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d295123-fe8e-4ea7-925f-1d024afbca46 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:06.596611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d295123-fe8e-4ea7-925f-1d024afbca46 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:06.596883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d295123-fe8e-4ea7-925f-1d024afbca46 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:06.597578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d295123-fe8e-4ea7-925f-1d024afbca46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:06.597881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d295123-fe8e-4ea7-925f-1d024afbca46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:06.598131 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2b47-a6b3-44de-8cde-4f9ebbb50e9d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:06.599262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d295123-fe8e-4ea7-925f-1d024afbca46 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:06.615396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 441/894] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:06.620746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d295123-fe8e-4ea7-925f-1d024afbca46 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:06.639746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d628ff-0fdf-40a7-9cf7-cbc321771162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:06.640383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d628ff-0fdf-40a7-9cf7-cbc321771162 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:06.640654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d628ff-0fdf-40a7-9cf7-cbc321771162 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:06.640919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d628ff-0fdf-40a7-9cf7-cbc321771162 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:06.641502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d628ff-0fdf-40a7-9cf7-cbc321771162 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:06.642859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d628ff-0fdf-40a7-9cf7-cbc321771162 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-06d628ff-0fdf-40a7-9cf7-cbc321771162 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:06.651994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:06.653062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:06.653940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 454/895] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:20:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:06.659408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d628ff-0fdf-40a7-9cf7-cbc321771162 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:06.688450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:06.765990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d295123-fe8e-4ea7-925f-1d024afbca46 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:06.774050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d628ff-0fdf-40a7-9cf7-cbc321771162 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:06.807452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5c4f8-9750-453e-b513-51352f71bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:06.808229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c4f8-9750-453e-b513-51352f71bf3e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:06.808599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c4f8-9750-453e-b513-51352f71bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:06.809094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c4f8-9750-453e-b513-51352f71bf3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:06.816192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5c4f8-9750-453e-b513-51352f71bf3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:06.817606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3804d28-70cc-4e7f-968e-94a0545673c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:06.817881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5c4f8-9750-453e-b513-51352f71bf3e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:06.818818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3804d28-70cc-4e7f-968e-94a0545673c0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:06.819245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3804d28-70cc-4e7f-968e-94a0545673c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:06.819703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3804d28-70cc-4e7f-968e-94a0545673c0 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:06.821150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3804d28-70cc-4e7f-968e-94a0545673c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:06.821602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3804d28-70cc-4e7f-968e-94a0545673c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:06.823108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3804d28-70cc-4e7f-968e-94a0545673c0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:06.829098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 455/896] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:20:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-caf5c4f8-9750-453e-b513-51352f71bf3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:20:06.830998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:06.832068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:06.833157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:20:06.833157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:20:06.833157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:20:06.833157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:20:06.833157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:20:06.833157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:20:06.833157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:06.833157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:06.839048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3804d28-70cc-4e7f-968e-94a0545673c0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:06.839188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 442/897] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:06.840296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5c4f8-9750-453e-b513-51352f71bf3e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:06.843498 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:06.944112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5c4f8-9750-453e-b513-51352f71bf3e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:06.952658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:06.966055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3804d28-70cc-4e7f-968e-94a0545673c0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:06.986241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065afca-95f9-4be6-b6ed-ce64d4440668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:06.986970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065afca-95f9-4be6-b6ed-ce64d4440668 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:06.987356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065afca-95f9-4be6-b6ed-ce64d4440668 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:06.987793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065afca-95f9-4be6-b6ed-ce64d4440668 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:06.988590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065afca-95f9-4be6-b6ed-ce64d4440668 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:06.988986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065afca-95f9-4be6-b6ed-ce64d4440668 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:06.990548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065afca-95f9-4be6-b6ed-ce64d4440668 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:07.008926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 443/898] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:07.010394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065afca-95f9-4be6-b6ed-ce64d4440668 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:07.011818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3d696-34f0-413d-8c4a-256c3fe55eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:07.012599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d696-34f0-413d-8c4a-256c3fe55eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.013015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d696-34f0-413d-8c4a-256c3fe55eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.013558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d696-34f0-413d-8c4a-256c3fe55eb9 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.014595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3d696-34f0-413d-8c4a-256c3fe55eb9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:07.015247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3d696-34f0-413d-8c4a-256c3fe55eb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:07.016779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3d696-34f0-413d-8c4a-256c3fe55eb9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:07.022599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 456/899] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:20:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:07.031424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3d696-34f0-413d-8c4a-256c3fe55eb9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:07.118422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:07.126259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065afca-95f9-4be6-b6ed-ce64d4440668 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:07.154807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3d696-34f0-413d-8c4a-256c3fe55eb9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:07.160702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accecaf-bd07-4973-b34f-1d4011680e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:07.161437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accecaf-bd07-4973-b34f-1d4011680e6c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.161804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accecaf-bd07-4973-b34f-1d4011680e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.162297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accecaf-bd07-4973-b34f-1d4011680e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.163034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accecaf-bd07-4973-b34f-1d4011680e6c None admin] RBAC: Adding query filter params (role.id=cc4b0fb15df246e28abd425b2bb85d33, scope.project.id=e6bea894013f40638404395075ade90d, user.id=cdff0406366845169a481e3cd1188725) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:07.163468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accecaf-bd07-4973-b34f-1d4011680e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:07.165003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accecaf-bd07-4973-b34f-1d4011680e6c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:07.180676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 444/900] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:20:07 2022] GET /identity/v3/role_assignments?user.id=cdff0406366845169a481e3cd1188725&scope.project.id=e6bea894013f40638404395075ade90d&role.id=cc4b0fb15df246e28abd425b2bb85d33 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:07.182239 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00100a7b-72ee-4187-b245-e789a5e68ec6 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.182626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00100a7b-72ee-4187-b245-e789a5e68ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.182939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00100a7b-72ee-4187-b245-e789a5e68ec6 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.191347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 445/901] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:07.191347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c39de4-ef4f-4a96-b98d-8b21146fc4f7 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.191347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c39de4-ef4f-4a96-b98d-8b21146fc4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.191347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c39de4-ef4f-4a96-b98d-8b21146fc4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.201220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd71b72-54bc-494b-a54f-23d82fd3d5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:07.202064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd71b72-54bc-494b-a54f-23d82fd3d5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.202622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd71b72-54bc-494b-a54f-23d82fd3d5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.203291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd71b72-54bc-494b-a54f-23d82fd3d5a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.204200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd71b72-54bc-494b-a54f-23d82fd3d5a6 None admin] RBAC: Adding query filter params (interface=public, service_id=088b590633554daf816ffe9458d5313e, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:07.204616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd71b72-54bc-494b-a54f-23d82fd3d5a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:07.206145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd71b72-54bc-494b-a54f-23d82fd3d5a6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:07.211401 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e6c39de4-ef4f-4a96-b98d-8b21146fc4f7 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:07.212658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e6c39de4-ef4f-4a96-b98d-8b21146fc4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:07.214663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 457/902] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 6 04:20:07 2022] GET /identity/v3/endpoints?service_id=088b590633554daf816ffe9458d5313e&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:07.221116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040998c-469f-488b-9dab-922b48ffff85 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.221493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040998c-469f-488b-9dab-922b48ffff85 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.222477 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040998c-469f-488b-9dab-922b48ffff85 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.224497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 458/903] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:07.225242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040998c-469f-488b-9dab-922b48ffff85 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:07.245572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:07.292698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 446/904] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:20:07.294351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e4f83-1878-45be-9918-af0bbe2df60a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.294632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e4f83-1878-45be-9918-af0bbe2df60a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.294899 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e4f83-1878-45be-9918-af0bbe2df60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.314601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-af7e4f83-1878-45be-9918-af0bbe2df60a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:07.318666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-af7e4f83-1878-45be-9918-af0bbe2df60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:07.367402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040998c-469f-488b-9dab-922b48ffff85 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:07.394733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 447/905] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:07.398330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:07.404783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70e992-fa0f-480a-8ccc-a5081a1a3f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:07.405496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70e992-fa0f-480a-8ccc-a5081a1a3f71 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.405777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70e992-fa0f-480a-8ccc-a5081a1a3f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.406045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70e992-fa0f-480a-8ccc-a5081a1a3f71 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.406654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70e992-fa0f-480a-8ccc-a5081a1a3f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:07.411362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70e992-fa0f-480a-8ccc-a5081a1a3f71 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:07.414252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 459/906] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 6 04:20:07 2022] GET /identity/v3/services => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:20:07.596948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e4f83-1878-45be-9918-af0bbe2df60a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:07.671069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70e992-fa0f-480a-8ccc-a5081a1a3f71 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:07.694307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:07.706332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e4f83-1878-45be-9918-af0bbe2df60a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:07.749781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56991981-8944-4c6d-a8c0-aae98196051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:07.751049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56991981-8944-4c6d-a8c0-aae98196051a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.751564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56991981-8944-4c6d-a8c0-aae98196051a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.752553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56991981-8944-4c6d-a8c0-aae98196051a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.753612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56991981-8944-4c6d-a8c0-aae98196051a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:07.756322 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56991981-8944-4c6d-a8c0-aae98196051a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-56991981-8944-4c6d-a8c0-aae98196051a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:07.767926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:07.768952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 04:20:07.769863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:07.772853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 448/907] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Oct 6 04:20:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:07.778507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56991981-8944-4c6d-a8c0-aae98196051a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:07.796635 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70e992-fa0f-480a-8ccc-a5081a1a3f71 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:07.832808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e03a9-3f69-4af0-ba9a-c452d5162949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:07.833844 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e03a9-3f69-4af0-ba9a-c452d5162949 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.834327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e03a9-3f69-4af0-ba9a-c452d5162949 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.834795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e03a9-3f69-4af0-ba9a-c452d5162949 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.835711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e03a9-3f69-4af0-ba9a-c452d5162949 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:07.837271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e03a9-3f69-4af0-ba9a-c452d5162949 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:07.863030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 460/908] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:20:07 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:20:07.914453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56991981-8944-4c6d-a8c0-aae98196051a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:07.960846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018fe11-d5cd-4128-93c6-b06bfa69442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:07.961472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018fe11-d5cd-4128-93c6-b06bfa69442c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:07.961743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018fe11-d5cd-4128-93c6-b06bfa69442c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:07.962011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018fe11-d5cd-4128-93c6-b06bfa69442c None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:07.962645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018fe11-d5cd-4128-93c6-b06bfa69442c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:07.962942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018fe11-d5cd-4128-93c6-b06bfa69442c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:07.964463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018fe11-d5cd-4128-93c6-b06bfa69442c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:07.970832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 449/909] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:07.977073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e03a9-3f69-4af0-ba9a-c452d5162949 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:08.041007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:08.094767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e03a9-3f69-4af0-ba9a-c452d5162949 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:08.132236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a171077-d8c2-4c54-b716-1a20a0b6d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:08.132900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a171077-d8c2-4c54-b716-1a20a0b6d77e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:08.133173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a171077-d8c2-4c54-b716-1a20a0b6d77e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:08.133529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a171077-d8c2-4c54-b716-1a20a0b6d77e None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:08.134300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a171077-d8c2-4c54-b716-1a20a0b6d77e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:08.134599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a171077-d8c2-4c54-b716-1a20a0b6d77e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:08.136004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a171077-d8c2-4c54-b716-1a20a0b6d77e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:08.145925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 461/910] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:08.147360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018fe11-d5cd-4128-93c6-b06bfa69442c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:08.164175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:08.255293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018fe11-d5cd-4128-93c6-b06bfa69442c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:08.289700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84964e59-2950-4dcd-8d4b-7adce01e959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:08.290317 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84964e59-2950-4dcd-8d4b-7adce01e959b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:08.290593 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84964e59-2950-4dcd-8d4b-7adce01e959b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:08.290870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84964e59-2950-4dcd-8d4b-7adce01e959b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:08.291616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84964e59-2950-4dcd-8d4b-7adce01e959b None admin] RBAC: Adding query filter params (interface=public, service_id=257edc1297a143f8963b2d7bc3f4ae2d, region_id=RegionOne) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:08.291925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84964e59-2950-4dcd-8d4b-7adce01e959b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:08.293315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84964e59-2950-4dcd-8d4b-7adce01e959b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:08.299112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 450/911] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 6 04:20:08 2022] GET /identity/v3/endpoints?service_id=257edc1297a143f8963b2d7bc3f4ae2d&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:08.304713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a171077-d8c2-4c54-b716-1a20a0b6d77e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:08.419629 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a171077-d8c2-4c54-b716-1a20a0b6d77e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:08.438188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:08.457112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7c6e5-1f7d-4e50-9e13-88339acc720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:08.458028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7c6e5-1f7d-4e50-9e13-88339acc720b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:08.458479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7c6e5-1f7d-4e50-9e13-88339acc720b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:08.458949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7c6e5-1f7d-4e50-9e13-88339acc720b None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:08.459790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7c6e5-1f7d-4e50-9e13-88339acc720b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:08.461335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7c6e5-1f7d-4e50-9e13-88339acc720b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:08.468067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 462/912] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 6 04:20:08 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:20:09.372011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd94d9-07e6-432c-828a-1ead9653dd10 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:09.372538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd94d9-07e6-432c-828a-1ead9653dd10 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:09.372538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd94d9-07e6-432c-828a-1ead9653dd10 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:09.374294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 451/913] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:09.380641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b5a72-a175-4912-84c5-f2537a982733 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:09.381043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b5a72-a175-4912-84c5-f2537a982733 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:09.381417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b5a72-a175-4912-84c5-f2537a982733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:09.400181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-287b5a72-a175-4912-84c5-f2537a982733 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:09.401376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-287b5a72-a175-4912-84c5-f2537a982733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:09.470173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 463/914] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:09.689880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286c3e-da76-4d55-a3cd-d4b1ddb9ab32 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:09.690588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286c3e-da76-4d55-a3cd-d4b1ddb9ab32 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:09.691080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286c3e-da76-4d55-a3cd-d4b1ddb9ab32 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:09.692926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 452/915] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:09.698508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b23462-a8f4-4526-81ee-3f03e83b59a9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:09.699036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b23462-a8f4-4526-81ee-3f03e83b59a9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:09.699570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b23462-a8f4-4526-81ee-3f03e83b59a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:09.718911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-33b23462-a8f4-4526-81ee-3f03e83b59a9 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:09.720460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-33b23462-a8f4-4526-81ee-3f03e83b59a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:09.737839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08286c3e-da76-4d55-a3cd-d4b1ddb9ab32 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:09.803849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 464/916] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:09.831789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:09.855164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08286c3e-da76-4d55-a3cd-d4b1ddb9ab32 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:09.890309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f520a47-9f6c-4807-a74d-45e7654204b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:09.890947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f520a47-9f6c-4807-a74d-45e7654204b5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:09.891275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f520a47-9f6c-4807-a74d-45e7654204b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:09.891565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f520a47-9f6c-4807-a74d-45e7654204b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:09.902113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f520a47-9f6c-4807-a74d-45e7654204b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-3f520a47-9f6c-4807-a74d-45e7654204b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:20:09.907553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:09.908484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:09.909350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 453/917] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 6 04:20:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:09.916724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b23462-a8f4-4526-81ee-3f03e83b59a9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:09.962592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:10.023224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b23462-a8f4-4526-81ee-3f03e83b59a9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:10.063765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727c895-9140-42a8-8555-49508a51720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:10.064761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727c895-9140-42a8-8555-49508a51720e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.065277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727c895-9140-42a8-8555-49508a51720e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.065749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727c895-9140-42a8-8555-49508a51720e None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.066628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727c895-9140-42a8-8555-49508a51720e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:10.067250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727c895-9140-42a8-8555-49508a51720e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:10.068851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727c895-9140-42a8-8555-49508a51720e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:10.078718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 465/918] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 6 04:20:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:10.088256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f520a47-9f6c-4807-a74d-45e7654204b5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:10.089215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727c895-9140-42a8-8555-49508a51720e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:10.198814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727c895-9140-42a8-8555-49508a51720e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:10.202582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:10.212075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f520a47-9f6c-4807-a74d-45e7654204b5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:10.237514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b107-b60b-4214-b233-79213fb35b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:10.238077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b107-b60b-4214-b233-79213fb35b5b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.238354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b107-b60b-4214-b233-79213fb35b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.238873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b107-b60b-4214-b233-79213fb35b5b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.239207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11b107-b60b-4214-b233-79213fb35b5b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:10.240639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11b107-b60b-4214-b233-79213fb35b5b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:10.247012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a10f06-0255-44a9-8877-5a01b8b1ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:10.247677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a10f06-0255-44a9-8877-5a01b8b1ae4b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.247950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a10f06-0255-44a9-8877-5a01b8b1ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.248214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a10f06-0255-44a9-8877-5a01b8b1ae4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8c11b107-b60b-4214-b233-79213fb35b5b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:10.250858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:10.251829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:10.252670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 466/919] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:20:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:10.253462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0ff71-0e5a-4e6c-a3f4-cc3acfb1324b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.253462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0ff71-0e5a-4e6c-a3f4-cc3acfb1324b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.254404 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0ff71-0e5a-4e6c-a3f4-cc3acfb1324b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.259095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 467/920] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:10.259095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0ff71-0e5a-4e6c-a3f4-cc3acfb1324b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:10.262457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:10.267222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a10f06-0255-44a9-8877-5a01b8b1ae4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:10.269371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a10f06-0255-44a9-8877-5a01b8b1ae4b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b3a10f06-0255-44a9-8877-5a01b8b1ae4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:10.284947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:10.285958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:10.286848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:10.286848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:10.286848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:10.286848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 454/921] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:10.287852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1789033-377c-4365-88ab-f005d7ca4129 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.287852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1789033-377c-4365-88ab-f005d7ca4129 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.287852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1789033-377c-4365-88ab-f005d7ca4129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.306624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e1789033-377c-4365-88ab-f005d7ca4129 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:10.307029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e1789033-377c-4365-88ab-f005d7ca4129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:10.381081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0ff71-0e5a-4e6c-a3f4-cc3acfb1324b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:10.390045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 455/922] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:10.390045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1789033-377c-4365-88ab-f005d7ca4129 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:10.416228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde25b4d-1457-4f69-90cc-b25ebd1c3ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:10.416888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde25b4d-1457-4f69-90cc-b25ebd1c3ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.417162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde25b4d-1457-4f69-90cc-b25ebd1c3ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.417426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde25b4d-1457-4f69-90cc-b25ebd1c3ea5 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.418103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde25b4d-1457-4f69-90cc-b25ebd1c3ea5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:10.418402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde25b4d-1457-4f69-90cc-b25ebd1c3ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:10.419862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde25b4d-1457-4f69-90cc-b25ebd1c3ea5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:10.430037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 468/923] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:20:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:10.431047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde25b4d-1457-4f69-90cc-b25ebd1c3ea5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:10.466301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:10.517306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1789033-377c-4365-88ab-f005d7ca4129 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:10.544462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde25b4d-1457-4f69-90cc-b25ebd1c3ea5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:10.551675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:10.562089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759e8a2-b843-4945-9c95-1f2dd6f9862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:10.562852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759e8a2-b843-4945-9c95-1f2dd6f9862d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.563277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759e8a2-b843-4945-9c95-1f2dd6f9862d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.563579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759e8a2-b843-4945-9c95-1f2dd6f9862d None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.564557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759e8a2-b843-4945-9c95-1f2dd6f9862d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:10.564862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759e8a2-b843-4945-9c95-1f2dd6f9862d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:10.566553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759e8a2-b843-4945-9c95-1f2dd6f9862d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:10.583461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 456/924] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:10.587496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759e8a2-b843-4945-9c95-1f2dd6f9862d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:10.588054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda671b-7564-4ce4-8281-36b6eaa8c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:10.588789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda671b-7564-4ce4-8281-36b6eaa8c29c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.589125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda671b-7564-4ce4-8281-36b6eaa8c29c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.589394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda671b-7564-4ce4-8281-36b6eaa8c29c None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.590103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda671b-7564-4ce4-8281-36b6eaa8c29c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:10.590451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda671b-7564-4ce4-8281-36b6eaa8c29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:10.592269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda671b-7564-4ce4-8281-36b6eaa8c29c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:10.598564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 469/925] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Oct 6 04:20:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:10.604232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda671b-7564-4ce4-8281-36b6eaa8c29c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:10.692138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759e8a2-b843-4945-9c95-1f2dd6f9862d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:10.701717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:10.707728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda671b-7564-4ce4-8281-36b6eaa8c29c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:10.726773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f081d-c47d-47a6-be59-29192c4e39a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:10.727414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f081d-c47d-47a6-be59-29192c4e39a8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.727688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f081d-c47d-47a6-be59-29192c4e39a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.727954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f081d-c47d-47a6-be59-29192c4e39a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.735857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f081d-c47d-47a6-be59-29192c4e39a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:10.737298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f081d-c47d-47a6-be59-29192c4e39a8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:10.740917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfcbc5-0e88-4b76-ab9e-ef40fbf28af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:10.741866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfcbc5-0e88-4b76-ab9e-ef40fbf28af1 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.742143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfcbc5-0e88-4b76-ab9e-ef40fbf28af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.742414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfcbc5-0e88-4b76-ab9e-ef40fbf28af1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.743078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfcbc5-0e88-4b76-ab9e-ef40fbf28af1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:10.744454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfcbc5-0e88-4b76-ab9e-ef40fbf28af1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-732f081d-c47d-47a6-be59-29192c4e39a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:20:10.748909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:10.749847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 457/926] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 6 04:20:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63ccc9-609a-43c9-b28b-5bc6f09f48c6 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.751506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63ccc9-609a-43c9-b28b-5bc6f09f48c6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.752341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63ccc9-609a-43c9-b28b-5bc6f09f48c6 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.752851 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 458/927] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:10.753586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63ccc9-609a-43c9-b28b-5bc6f09f48c6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:10.769318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 470/928] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:20:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:20:10.769911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfcbc5-0e88-4b76-ab9e-ef40fbf28af1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:10.810998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:10.882154 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63ccc9-609a-43c9-b28b-5bc6f09f48c6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:10.890621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfcbc5-0e88-4b76-ab9e-ef40fbf28af1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:10.929177 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783f199-6247-4eda-997f-1411e1f740f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:10.929833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783f199-6247-4eda-997f-1411e1f740f0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.929962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55489cdb-1f08-4d81-84c2-395d52297179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:10.930086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783f199-6247-4eda-997f-1411e1f740f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.930358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783f199-6247-4eda-997f-1411e1f740f0 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.930501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489cdb-1f08-4d81-84c2-395d52297179 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.930798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489cdb-1f08-4d81-84c2-395d52297179 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.931070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489cdb-1f08-4d81-84c2-395d52297179 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.931215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783f199-6247-4eda-997f-1411e1f740f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:10.931443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783f199-6247-4eda-997f-1411e1f740f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:10.931677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55489cdb-1f08-4d81-84c2-395d52297179 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:10.932869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783f199-6247-4eda-997f-1411e1f740f0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:10.933118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55489cdb-1f08-4d81-84c2-395d52297179 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-55489cdb-1f08-4d81-84c2-395d52297179 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:10.943291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:10.944691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:10.946229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 459/929] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:10.947041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e712cf-3ae6-4d43-b223-31908127b874 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:10.947041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e712cf-3ae6-4d43-b223-31908127b874 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:10.947041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e712cf-3ae6-4d43-b223-31908127b874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:10.959442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 471/930] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Oct 6 04:20:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:10.959442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783f199-6247-4eda-997f-1411e1f740f0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:10.968456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-89e712cf-3ae6-4d43-b223-31908127b874 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:10.969655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-89e712cf-3ae6-4d43-b223-31908127b874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:10.970974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:11.049086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 460/931] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:11.049858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e712cf-3ae6-4d43-b223-31908127b874 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.080120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783f199-6247-4eda-997f-1411e1f740f0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.110871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:11.120642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f3d44-080a-4aad-bc54-2bafa263b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.121457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f3d44-080a-4aad-bc54-2bafa263b45f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.121993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f3d44-080a-4aad-bc54-2bafa263b45f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.121993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f3d44-080a-4aad-bc54-2bafa263b45f None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.122428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f3d44-080a-4aad-bc54-2bafa263b45f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:11.122730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f3d44-080a-4aad-bc54-2bafa263b45f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:11.124697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f3d44-080a-4aad-bc54-2bafa263b45f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:11.134505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 472/932] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 6 04:20:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:11.135588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f3d44-080a-4aad-bc54-2bafa263b45f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.185534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e712cf-3ae6-4d43-b223-31908127b874 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.223440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9feca1-35b5-4cc0-99e2-424dcc1dab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.224350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9feca1-35b5-4cc0-99e2-424dcc1dab2a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.224768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9feca1-35b5-4cc0-99e2-424dcc1dab2a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.225179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9feca1-35b5-4cc0-99e2-424dcc1dab2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.230270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:11.236983 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9feca1-35b5-4cc0-99e2-424dcc1dab2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:11.238730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9feca1-35b5-4cc0-99e2-424dcc1dab2a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-fe9feca1-35b5-4cc0-99e2-424dcc1dab2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:11.257054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:11.258074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:11.259046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:11.259046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:11.259046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:11.259225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f3d44-080a-4aad-bc54-2bafa263b45f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.261091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 461/933] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:11.272109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9feca1-35b5-4cc0-99e2-424dcc1dab2a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.303486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd595b2c-cdcc-4b86-a078-22208e5da9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.304732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd595b2c-cdcc-4b86-a078-22208e5da9bf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.305237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd595b2c-cdcc-4b86-a078-22208e5da9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.305694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd595b2c-cdcc-4b86-a078-22208e5da9bf None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.306664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd595b2c-cdcc-4b86-a078-22208e5da9bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:11.307167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd595b2c-cdcc-4b86-a078-22208e5da9bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:11.309083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd595b2c-cdcc-4b86-a078-22208e5da9bf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:11.319011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 473/934] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 6 04:20:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:11.325207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd595b2c-cdcc-4b86-a078-22208e5da9bf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.371439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:11.390291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9feca1-35b5-4cc0-99e2-424dcc1dab2a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.428601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4781ad-76a9-4560-88e7-4372560e4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.429196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4781ad-76a9-4560-88e7-4372560e4b6a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.429455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4781ad-76a9-4560-88e7-4372560e4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.429718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4781ad-76a9-4560-88e7-4372560e4b6a None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.430352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4781ad-76a9-4560-88e7-4372560e4b6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:11.430643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4781ad-76a9-4560-88e7-4372560e4b6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:11.432036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4781ad-76a9-4560-88e7-4372560e4b6a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:11.436172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd595b2c-cdcc-4b86-a078-22208e5da9bf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.443429 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 462/935] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:11.444224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4781ad-76a9-4560-88e7-4372560e4b6a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.477798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269eeac-efb9-4dd6-b6d4-8e13a1f07d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.478743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269eeac-efb9-4dd6-b6d4-8e13a1f07d2d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.479189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269eeac-efb9-4dd6-b6d4-8e13a1f07d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.479647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269eeac-efb9-4dd6-b6d4-8e13a1f07d2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.480616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269eeac-efb9-4dd6-b6d4-8e13a1f07d2d None admin] RBAC: Adding query filter params (interface=public, service_id=e7fe09d04f8e47eeb9dd5c5db4f787a5, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:11.481170 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269eeac-efb9-4dd6-b6d4-8e13a1f07d2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:11.482589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269eeac-efb9-4dd6-b6d4-8e13a1f07d2d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:11.488008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 474/936] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 6 04:20:11 2022] GET /identity/v3/endpoints?service_id=e7fe09d04f8e47eeb9dd5c5db4f787a5&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:11.488794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269eeac-efb9-4dd6-b6d4-8e13a1f07d2d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.492077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:11.556048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4781ad-76a9-4560-88e7-4372560e4b6a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.589382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aefc2-b55a-41cd-88ea-142c4c01cb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.590012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aefc2-b55a-41cd-88ea-142c4c01cb07 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.590279 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aefc2-b55a-41cd-88ea-142c4c01cb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.590548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aefc2-b55a-41cd-88ea-142c4c01cb07 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.591117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689aefc2-b55a-41cd-88ea-142c4c01cb07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:11.592816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689aefc2-b55a-41cd-88ea-142c4c01cb07 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:11.597518 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269eeac-efb9-4dd6-b6d4-8e13a1f07d2d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-689aefc2-b55a-41cd-88ea-142c4c01cb07 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:11.601405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:11.602365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:11.603290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 463/937] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Oct 6 04:20:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:11.608266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aefc2-b55a-41cd-88ea-142c4c01cb07 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.618220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:11.635237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e9bb8-6799-4295-96d6-bf964ae8a26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.635905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e9bb8-6799-4295-96d6-bf964ae8a26c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.636182 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e9bb8-6799-4295-96d6-bf964ae8a26c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.636448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e9bb8-6799-4295-96d6-bf964ae8a26c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.643177 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e9bb8-6799-4295-96d6-bf964ae8a26c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:11.644645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e9bb8-6799-4295-96d6-bf964ae8a26c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-de9e9bb8-6799-4295-96d6-bf964ae8a26c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:20:11.655982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:11.656866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:11.657753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:20:11.657753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:20:11.657753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:20:11.657753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:20:11.657753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:20:11.657753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:20:11.657753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:11.657753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:11.657753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 475/938] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:11.658230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e9bb8-6799-4295-96d6-bf964ae8a26c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.721040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aefc2-b55a-41cd-88ea-142c4c01cb07 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.725842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:11.757983 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957b61e-3cca-48e9-afdc-1a2d19bf8605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.758455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b61e-3cca-48e9-afdc-1a2d19bf8605 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.758730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b61e-3cca-48e9-afdc-1a2d19bf8605 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.759040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b61e-3cca-48e9-afdc-1a2d19bf8605 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.759625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957b61e-3cca-48e9-afdc-1a2d19bf8605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:11.761004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957b61e-3cca-48e9-afdc-1a2d19bf8605 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:11.775341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 464/939] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 6 04:20:11 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:20:11.775568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e9bb8-6799-4295-96d6-bf964ae8a26c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.775665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957b61e-3cca-48e9-afdc-1a2d19bf8605 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.813239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c72f4a-9e0f-433c-8900-0b3f45d7c409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.813893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c72f4a-9e0f-433c-8900-0b3f45d7c409 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.814224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c72f4a-9e0f-433c-8900-0b3f45d7c409 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.814746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c72f4a-9e0f-433c-8900-0b3f45d7c409 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.816373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c72f4a-9e0f-433c-8900-0b3f45d7c409 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:11.816812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c72f4a-9e0f-433c-8900-0b3f45d7c409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:11.818289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c72f4a-9e0f-433c-8900-0b3f45d7c409 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:11.827488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 476/940] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:11.830792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c72f4a-9e0f-433c-8900-0b3f45d7c409 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.867402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:11.897148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957b61e-3cca-48e9-afdc-1a2d19bf8605 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.934813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7618664-0950-40b5-8dcf-02bde9c5d225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.935979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618664-0950-40b5-8dcf-02bde9c5d225 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.936536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618664-0950-40b5-8dcf-02bde9c5d225 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.936976 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618664-0950-40b5-8dcf-02bde9c5d225 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.937822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7618664-0950-40b5-8dcf-02bde9c5d225 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:11.938296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7618664-0950-40b5-8dcf-02bde9c5d225 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:11.940009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7618664-0950-40b5-8dcf-02bde9c5d225 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:11.955260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 465/941] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:11.956579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c72f4a-9e0f-433c-8900-0b3f45d7c409 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:11.967218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7618664-0950-40b5-8dcf-02bde9c5d225 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:11.985763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:11.996565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263cbc7-86dc-41d2-821a-9ae1b82c254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:11.997426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263cbc7-86dc-41d2-821a-9ae1b82c254c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:11.998073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263cbc7-86dc-41d2-821a-9ae1b82c254c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:11.998534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263cbc7-86dc-41d2-821a-9ae1b82c254c None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:11.999148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263cbc7-86dc-41d2-821a-9ae1b82c254c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:11.999547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263cbc7-86dc-41d2-821a-9ae1b82c254c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:12.001004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263cbc7-86dc-41d2-821a-9ae1b82c254c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:12.006979 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 477/942] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:12.012853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263cbc7-86dc-41d2-821a-9ae1b82c254c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:12.083558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7618664-0950-40b5-8dcf-02bde9c5d225 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:12.123929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:12.132247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230936ac-e00f-4669-98dd-ca430c7c35d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:12.133179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230936ac-e00f-4669-98dd-ca430c7c35d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:12.133454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230936ac-e00f-4669-98dd-ca430c7c35d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:12.133722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230936ac-e00f-4669-98dd-ca430c7c35d4 None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/cdff0406366845169a481e3cd1188725/roles/cc4b0fb15df246e28abd425b2bb85d33` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:12.136822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230936ac-e00f-4669-98dd-ca430c7c35d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=cdff0406366845169a481e3cd1188725, role_id=cc4b0fb15df246e28abd425b2bb85d33)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:12.139172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230936ac-e00f-4669-98dd-ca430c7c35d4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:12.145007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263cbc7-86dc-41d2-821a-9ae1b82c254c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:12.157416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 466/943] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:20:11 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/cdff0406366845169a481e3cd1188725/roles/cc4b0fb15df246e28abd425b2bb85d33 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:20:12.188452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bad22-4874-4acc-a9b4-fbe81737f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:12.189092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bad22-4874-4acc-a9b4-fbe81737f09a None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:12.189365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bad22-4874-4acc-a9b4-fbe81737f09a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:12.189629 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bad22-4874-4acc-a9b4-fbe81737f09a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:12.190327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bad22-4874-4acc-a9b4-fbe81737f09a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:12.191860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bad22-4874-4acc-a9b4-fbe81737f09a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:12.219083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 478/944] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:20:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:20:13.048761 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72eba-8e71-4a1d-8893-4932f30bdce9 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:13.049387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72eba-8e71-4a1d-8893-4932f30bdce9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:13.049540 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72eba-8e71-4a1d-8893-4932f30bdce9 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:13.051164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 467/945] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:13.056634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f45ddf-42c6-44f4-8506-efef34036247 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:13.057100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f45ddf-42c6-44f4-8506-efef34036247 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:13.057306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f45ddf-42c6-44f4-8506-efef34036247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:13.078406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c2f45ddf-42c6-44f4-8506-efef34036247 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:13.079695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c2f45ddf-42c6-44f4-8506-efef34036247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:13.128264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:13.162792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 479/946] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:13.443059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e72eba-8e71-4a1d-8893-4932f30bdce9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:13.554242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e72eba-8e71-4a1d-8893-4932f30bdce9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:13.591086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:13.591655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:13.591961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:13.592714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:13.593403 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:13.594846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:13.597513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WARNING keystone.server.flask.common [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 06 04:20:13.617931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.sql.core [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 06 04:20:13.617931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 06 04:20:13.617931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [parameters: {'id': '93a8347a37d34e0aa211a4ceb9102481', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 06 04:20:13.617931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81436) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 93a8347a37d34e0aa211a4ceb9102481.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 93a8347a37d34e0aa211a4ceb9102481. Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application conn.query(q) Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 04:20:13.626088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result.read() Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 06 04:20:13.627834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application next(self.gen) Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application yield resource Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application next(self.gen) Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.session.rollback() Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.force_reraise() Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise self.value Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application session.commit() Oct 06 04:20:13.630090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._prepare_impl() Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.session.flush() Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._flush(objects) Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application compat.raise_( Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application flush_context.execute() Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 04:20:13.635924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rec.execute(self) Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 06 04:20:13.637047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application conn.query(q) Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result.read() Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 04:20:13.638067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [parameters: {'id': '93a8347a37d34e0aa211a4ceb9102481', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:13.639209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:13.641209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:13.643071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:13.643071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 06 04:20:13.643071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 06 04:20:13.643071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:13.643071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:13.643071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 06 04:20:13.643071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 06 04:20:13.643071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 93a8347a37d34e0aa211a4ceb9102481. Oct 06 04:20:13.643071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:13.643071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 468/947] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Oct 6 04:20:13 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:13.647536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f45ddf-42c6-44f4-8506-efef34036247 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:13.752811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f45ddf-42c6-44f4-8506-efef34036247 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:13.788880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd5df2-a73d-4e4a-ae9e-a2116520ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:13.789849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd5df2-a73d-4e4a-ae9e-a2116520ffdd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:13.790305 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd5df2-a73d-4e4a-ae9e-a2116520ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:13.790745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd5df2-a73d-4e4a-ae9e-a2116520ffdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:13.798228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd5df2-a73d-4e4a-ae9e-a2116520ffdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:13.799942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd5df2-a73d-4e4a-ae9e-a2116520ffdd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e8fd5df2-a73d-4e4a-ae9e-a2116520ffdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:20:13.814760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:13.815703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:13.816632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:20:13.816632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:20:13.816632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:20:13.816632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:20:13.816632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:20:13.816632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:20:13.816632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:13.816632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:13.818731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 480/948] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:13.825018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:13.876993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:13.940023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f3b9-173e-4233-8778-5e94a37734ec None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:13.976700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9e6c5-c47e-4c35-a59f-397ca5fc9e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:13.977601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9e6c5-c47e-4c35-a59f-397ca5fc9e97 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:13.978024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9e6c5-c47e-4c35-a59f-397ca5fc9e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:13.978449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9e6c5-c47e-4c35-a59f-397ca5fc9e97 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:13.979277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9e6c5-c47e-4c35-a59f-397ca5fc9e97 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:13.979762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9e6c5-c47e-4c35-a59f-397ca5fc9e97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:13.981554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9e6c5-c47e-4c35-a59f-397ca5fc9e97 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:14.004280 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 469/949] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:20:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:14.021068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bba38e-207d-408b-8210-51ce0786e255 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:14.021598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bba38e-207d-408b-8210-51ce0786e255 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:14.022042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bba38e-207d-408b-8210-51ce0786e255 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:14.023843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 481/950] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:14.034343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a003513-239a-46ce-bf34-7e03817e6e0c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:14.034714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a003513-239a-46ce-bf34-7e03817e6e0c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:14.034886 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a003513-239a-46ce-bf34-7e03817e6e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:14.056225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1a003513-239a-46ce-bf34-7e03817e6e0c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:14.058665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1a003513-239a-46ce-bf34-7e03817e6e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:14.141162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 470/951] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:14.375221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608495c-d970-447e-9057-f4e85a61220d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:14.375789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608495c-d970-447e-9057-f4e85a61220d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:14.375789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608495c-d970-447e-9057-f4e85a61220d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:14.377473 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 482/952] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:14.383454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bba56-1a9b-4713-bf59-dedc8a3de85f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:14.383766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bba56-1a9b-4713-bf59-dedc8a3de85f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:14.384003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bba56-1a9b-4713-bf59-dedc8a3de85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:14.402999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-506bba56-1a9b-4713-bf59-dedc8a3de85f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:14.404137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-506bba56-1a9b-4713-bf59-dedc8a3de85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:14.434619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:14.441153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608495c-d970-447e-9057-f4e85a61220d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:14.475607 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:14.492153 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 471/953] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:14.493427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c04b7f-dcca-4879-b452-f47fe0ae027d None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:14.493713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c04b7f-dcca-4879-b452-f47fe0ae027d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:14.493985 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c04b7f-dcca-4879-b452-f47fe0ae027d None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:14.495380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 472/954] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:14.501131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6aaea6-7b4b-40c2-b3db-c0e9b0b00917 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:14.501411 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6aaea6-7b4b-40c2-b3db-c0e9b0b00917 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:14.501691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6aaea6-7b4b-40c2-b3db-c0e9b0b00917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:14.520547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4a6aaea6-7b4b-40c2-b3db-c0e9b0b00917 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:14.521793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4a6aaea6-7b4b-40c2-b3db-c0e9b0b00917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:14.567769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608495c-d970-447e-9057-f4e85a61220d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:14.603488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 473/955] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:20:14.609314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe678-5a64-4b87-8bd4-dfb16de7b48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:14.610124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe678-5a64-4b87-8bd4-dfb16de7b48b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:14.610540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe678-5a64-4b87-8bd4-dfb16de7b48b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:14.610941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe678-5a64-4b87-8bd4-dfb16de7b48b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:14.611688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fe678-5a64-4b87-8bd4-dfb16de7b48b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:14.613214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fe678-5a64-4b87-8bd4-dfb16de7b48b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-861fe678-5a64-4b87-8bd4-dfb16de7b48b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:14.622568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:14.623973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:14.625199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:14.627625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 483/956] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:14.633537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6aaea6-7b4b-40c2-b3db-c0e9b0b00917 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:14.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:14.735741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6aaea6-7b4b-40c2-b3db-c0e9b0b00917 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:14.770756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000d37a-5320-4707-91cb-3ee59c67671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:14.771386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000d37a-5320-4707-91cb-3ee59c67671e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:14.771658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000d37a-5320-4707-91cb-3ee59c67671e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:14.772064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000d37a-5320-4707-91cb-3ee59c67671e None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:14.772693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000d37a-5320-4707-91cb-3ee59c67671e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:14.773040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000d37a-5320-4707-91cb-3ee59c67671e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:14.774411 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000d37a-5320-4707-91cb-3ee59c67671e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:14.783432 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 474/957] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 6 04:20:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:14.785829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe678-5a64-4b87-8bd4-dfb16de7b48b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:14.802666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000d37a-5320-4707-91cb-3ee59c67671e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:14.907117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000d37a-5320-4707-91cb-3ee59c67671e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:14.907553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:14.914261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe678-5a64-4b87-8bd4-dfb16de7b48b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:14.943100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c6d28-f827-4cdc-8f3c-fe3ea9fcb8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:14.944802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c6d28-f827-4cdc-8f3c-fe3ea9fcb8fc None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:14.945224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c6d28-f827-4cdc-8f3c-fe3ea9fcb8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:14.945789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c6d28-f827-4cdc-8f3c-fe3ea9fcb8fc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:14.952605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e05f-a589-4476-854f-4c1c19fbf733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:14.953242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e05f-a589-4476-854f-4c1c19fbf733 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:14.953517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e05f-a589-4476-854f-4c1c19fbf733 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:14.953782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e05f-a589-4476-854f-4c1c19fbf733 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:14.954429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e05f-a589-4476-854f-4c1c19fbf733 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:14.954733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e05f-a589-4476-854f-4c1c19fbf733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:14.956409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e05f-a589-4476-854f-4c1c19fbf733 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:14.960420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c6d28-f827-4cdc-8f3c-fe3ea9fcb8fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:20:14.962321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 484/958] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 6 04:20:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:14.964261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e05f-a589-4476-854f-4c1c19fbf733 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-132c6d28-f827-4cdc-8f3c-fe3ea9fcb8fc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:20:14.966756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:14.968016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:14.968861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:14.970988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 475/959] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 6 04:20:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:14.971997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c6d28-f827-4cdc-8f3c-fe3ea9fcb8fc None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:15.000193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:15.071163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e05f-a589-4476-854f-4c1c19fbf733 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:15.080855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c6d28-f827-4cdc-8f3c-fe3ea9fcb8fc None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:15.105566 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b28f7-1f0c-4c91-8aa9-a517a0b71691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:15.106196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b28f7-1f0c-4c91-8aa9-a517a0b71691 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:15.106469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b28f7-1f0c-4c91-8aa9-a517a0b71691 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:15.106730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b28f7-1f0c-4c91-8aa9-a517a0b71691 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:15.107325 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b28f7-1f0c-4c91-8aa9-a517a0b71691 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:15.108776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b28f7-1f0c-4c91-8aa9-a517a0b71691 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:15.116334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b3500-40b5-43d0-aa32-1828636ccdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:15.116943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b3500-40b5-43d0-aa32-1828636ccdd8 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:15.117218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b3500-40b5-43d0-aa32-1828636ccdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:15.117485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b3500-40b5-43d0-aa32-1828636ccdd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a00b28f7-1f0c-4c91-8aa9-a517a0b71691 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:15.118052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:15.118985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 04:20:15.120461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:15.121198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b3500-40b5-43d0-aa32-1828636ccdd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:15.121270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 485/960] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:15.121270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b28f7-1f0c-4c91-8aa9-a517a0b71691 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:15.125171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b3500-40b5-43d0-aa32-1828636ccdd8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:15.155371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 476/961] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:20:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:20:15.155371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b3500-40b5-43d0-aa32-1828636ccdd8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:15.156824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:15.247196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b28f7-1f0c-4c91-8aa9-a517a0b71691 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:15.252407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:15.289287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b3500-40b5-43d0-aa32-1828636ccdd8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:15.291631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a468ad-d35d-4d55-af4c-57f696e6691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:15.293153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a468ad-d35d-4d55-af4c-57f696e6691f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:15.293430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a468ad-d35d-4d55-af4c-57f696e6691f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:15.293703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a468ad-d35d-4d55-af4c-57f696e6691f None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:15.294386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a468ad-d35d-4d55-af4c-57f696e6691f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:15.294690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a468ad-d35d-4d55-af4c-57f696e6691f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:15.296431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a468ad-d35d-4d55-af4c-57f696e6691f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:15.310194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 486/962] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 6 04:20:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:15.316628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a468ad-d35d-4d55-af4c-57f696e6691f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:15.340014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0323a-291a-45d0-aa4a-730f2ab6446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:15.341149 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0323a-291a-45d0-aa4a-730f2ab6446b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:15.341744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0323a-291a-45d0-aa4a-730f2ab6446b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:15.342283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0323a-291a-45d0-aa4a-730f2ab6446b None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:15.343137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0323a-291a-45d0-aa4a-730f2ab6446b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:15.343694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0323a-291a-45d0-aa4a-730f2ab6446b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:15.345490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0323a-291a-45d0-aa4a-730f2ab6446b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:15.351624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 477/963] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:20:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:15.357824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0323a-291a-45d0-aa4a-730f2ab6446b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:15.422471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:15.447377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a468ad-d35d-4d55-af4c-57f696e6691f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:15.480639 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0323a-291a-45d0-aa4a-730f2ab6446b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:15.480840 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20ca3c-a6b5-4611-835c-05d9a4200b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:15.481484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ca3c-a6b5-4611-835c-05d9a4200b73 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:15.481761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ca3c-a6b5-4611-835c-05d9a4200b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:15.482027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ca3c-a6b5-4611-835c-05d9a4200b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:15.493925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20ca3c-a6b5-4611-835c-05d9a4200b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:15.495376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20ca3c-a6b5-4611-835c-05d9a4200b73 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3a20ca3c-a6b5-4611-835c-05d9a4200b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:15.517401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:15.518371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:15.519429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:15.519429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:15.519429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:15.519429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 487/964] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:15.525378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20ca3c-a6b5-4611-835c-05d9a4200b73 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:15.535695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4d685-a174-494d-93ec-141481531813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:15.536313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d685-a174-494d-93ec-141481531813 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:15.537077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d685-a174-494d-93ec-141481531813 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:15.537362 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d685-a174-494d-93ec-141481531813 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:15.538004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4d685-a174-494d-93ec-141481531813 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:15.538346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4d685-a174-494d-93ec-141481531813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:15.540636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4d685-a174-494d-93ec-141481531813 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:15.543525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:15.548684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 478/965] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:20:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:15.649192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20ca3c-a6b5-4611-835c-05d9a4200b73 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:15.689406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e0eb4-721b-488e-ab50-87e10e8da585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:15.690312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e0eb4-721b-488e-ab50-87e10e8da585 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:15.690761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e0eb4-721b-488e-ab50-87e10e8da585 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:15.691191 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e0eb4-721b-488e-ab50-87e10e8da585 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:15.692029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e0eb4-721b-488e-ab50-87e10e8da585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:15.692480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e0eb4-721b-488e-ab50-87e10e8da585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:15.694016 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e0eb4-721b-488e-ab50-87e10e8da585 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:15.695934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:15.709856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 488/966] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:15.716568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4d685-a174-494d-93ec-141481531813 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:15.831008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4d685-a174-494d-93ec-141481531813 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:15.867933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22983785-58bd-4720-bb01-a0a6e4ea9d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:15.868816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22983785-58bd-4720-bb01-a0a6e4ea9d53 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:15.869262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22983785-58bd-4720-bb01-a0a6e4ea9d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:15.869690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22983785-58bd-4720-bb01-a0a6e4ea9d53 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:15.878639 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22983785-58bd-4720-bb01-a0a6e4ea9d53 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:15.880333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22983785-58bd-4720-bb01-a0a6e4ea9d53 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-22983785-58bd-4720-bb01-a0a6e4ea9d53 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:20:15.893890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:15.895093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:15.896137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 479/967] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 6 04:20:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:15.902987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e0eb4-721b-488e-ab50-87e10e8da585 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:16.015087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e0eb4-721b-488e-ab50-87e10e8da585 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:16.052493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697a9fc-0712-4bfa-9a32-5d986ad10962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:16.053514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697a9fc-0712-4bfa-9a32-5d986ad10962 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:16.053994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697a9fc-0712-4bfa-9a32-5d986ad10962 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:16.054461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697a9fc-0712-4bfa-9a32-5d986ad10962 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:16.055428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697a9fc-0712-4bfa-9a32-5d986ad10962 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:16.055947 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697a9fc-0712-4bfa-9a32-5d986ad10962 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:16.057678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697a9fc-0712-4bfa-9a32-5d986ad10962 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:16.077850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 489/968] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Oct 6 04:20:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:16.084049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22983785-58bd-4720-bb01-a0a6e4ea9d53 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:16.156609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:16.203253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22983785-58bd-4720-bb01-a0a6e4ea9d53 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:16.239809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d5bb9-109e-4e27-b3f1-48d18bf4d655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:16.240887 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d5bb9-109e-4e27-b3f1-48d18bf4d655 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:16.241703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d5bb9-109e-4e27-b3f1-48d18bf4d655 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:16.242169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d5bb9-109e-4e27-b3f1-48d18bf4d655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:16.262463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dda62-0807-45c3-877d-e9b590976f38 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:16.262816 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dda62-0807-45c3-877d-e9b590976f38 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:16.263010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dda62-0807-45c3-877d-e9b590976f38 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:16.265739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 490/969] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:16.272945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e14765-8790-4d16-9776-2e1f51fee1ef None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:16.273346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e14765-8790-4d16-9776-2e1f51fee1ef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:16.273705 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e14765-8790-4d16-9776-2e1f51fee1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:16.296138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-80e14765-8790-4d16-9776-2e1f51fee1ef None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:16.297713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-80e14765-8790-4d16-9776-2e1f51fee1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:16.337708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d5bb9-109e-4e27-b3f1-48d18bf4d655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:16.339559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d5bb9-109e-4e27-b3f1-48d18bf4d655 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:16.363063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:16.399689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 491/970] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:20:16.410119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:16.455919 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 480/971] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:20:16 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:20:16.464793 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e14765-8790-4d16-9776-2e1f51fee1ef None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:16.566102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e14765-8790-4d16-9776-2e1f51fee1ef None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:16.601117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca7761-c5f5-4d4e-8ec2-5cc5211f25d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:16.601680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca7761-c5f5-4d4e-8ec2-5cc5211f25d5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:16.601950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca7761-c5f5-4d4e-8ec2-5cc5211f25d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:16.602216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca7761-c5f5-4d4e-8ec2-5cc5211f25d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:16.612303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca7761-c5f5-4d4e-8ec2-5cc5211f25d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:16.613753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca7761-c5f5-4d4e-8ec2-5cc5211f25d5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8fca7761-c5f5-4d4e-8ec2-5cc5211f25d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:16.628540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:16.629502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:16.630439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:16.630439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:16.630439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:16.630439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 492/972] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:16.635618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d5bb9-109e-4e27-b3f1-48d18bf4d655 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:16.711268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca7761-c5f5-4d4e-8ec2-5cc5211f25d5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:16.740240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d5bb9-109e-4e27-b3f1-48d18bf4d655 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:16.749863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:16.778341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53408b17-90ae-474b-9a20-deb7491a26a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:16.778944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53408b17-90ae-474b-9a20-deb7491a26a5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:16.779228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53408b17-90ae-474b-9a20-deb7491a26a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:16.779814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53408b17-90ae-474b-9a20-deb7491a26a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:16.780468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53408b17-90ae-474b-9a20-deb7491a26a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:16.780768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53408b17-90ae-474b-9a20-deb7491a26a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:16.782495 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53408b17-90ae-474b-9a20-deb7491a26a5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:16.794881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 481/973] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:16.800846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53408b17-90ae-474b-9a20-deb7491a26a5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:16.823105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca7761-c5f5-4d4e-8ec2-5cc5211f25d5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:16.825864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:16.859020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:16.859822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:16.860204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:16.860801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:16.861487 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:16.863117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:16.865841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: WARNING keystone.server.flask.common [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 06 04:20:16.881577 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.sql.core [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 06 04:20:16.881577 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 06 04:20:16.881577 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [parameters: {'user_id': '56bf625f6d5d44e5b58e46d5af97c252', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 06 04:20:16.881577 dv-cinder-860227-2-smb devstack@keystone.service[81437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81437) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Oct 06 04:20:16.900133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 04:20:16.901163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application yield resource Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.rollback() Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.force_reraise() Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise self.value Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application session.commit() Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 06 04:20:16.902134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._prepare_impl() Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.flush() Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._flush(objects) Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application compat.raise_( Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application flush_context.execute() Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rec.execute(self) Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 04:20:16.903041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 04:20:16.903959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 04:20:16.906293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [parameters: {'user_id': '56bf625f6d5d44e5b58e46d5af97c252', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:16.909005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 06 04:20:16.910902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 06 04:20:16.913220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 06 04:20:16.913220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 06 04:20:16.913220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 06 04:20:16.913220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 06 04:20:16.913220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 06 04:20:16.913220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:16.913220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 493/974] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Oct 6 04:20:16 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:16.913220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:16.927719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53408b17-90ae-474b-9a20-deb7491a26a5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:16.965080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56143f-0b1b-45c4-a86e-f361cd6c94a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:16.965755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56143f-0b1b-45c4-a86e-f361cd6c94a8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:16.966028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56143f-0b1b-45c4-a86e-f361cd6c94a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:16.966341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56143f-0b1b-45c4-a86e-f361cd6c94a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:16.974355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56143f-0b1b-45c4-a86e-f361cd6c94a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:16.975966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56143f-0b1b-45c4-a86e-f361cd6c94a8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-2f56143f-0b1b-45c4-a86e-f361cd6c94a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:20:16.988766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:16.990921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:16.993454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:20:16.993454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:20:16.993454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:20:16.993454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:20:16.993454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:20:16.993454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:20:16.993454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:16.993454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:16.993454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 482/975] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:17.001361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56143f-0b1b-45c4-a86e-f361cd6c94a8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:17.014058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:17.020579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d4405-9953-49e7-b554-62e3667e50ce None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:17.058687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97722c-0ca0-4d4b-adf8-3b24ef29e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:17.059375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97722c-0ca0-4d4b-adf8-3b24ef29e313 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:17.059631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97722c-0ca0-4d4b-adf8-3b24ef29e313 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:17.059905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97722c-0ca0-4d4b-adf8-3b24ef29e313 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:17.069064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97722c-0ca0-4d4b-adf8-3b24ef29e313 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:17.070794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97722c-0ca0-4d4b-adf8-3b24ef29e313 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7f97722c-0ca0-4d4b-adf8-3b24ef29e313 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:20:17.083378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:17.084366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:17.085303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:17.085303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:17.085303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:20:17.085303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:20:17.085303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:20:17.085303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:20:17.085303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:20:17.085303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:20:17.085303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 04:20:17.085303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:17.089739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 494/976] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:20:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:17.090494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97722c-0ca0-4d4b-adf8-3b24ef29e313 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:17.121170 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:17.152949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56143f-0b1b-45c4-a86e-f361cd6c94a8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:17.193093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f3ef-792e-43c5-a6e3-2dee2e561522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:17.194100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f3ef-792e-43c5-a6e3-2dee2e561522 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:17.194573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f3ef-792e-43c5-a6e3-2dee2e561522 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:17.195048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f3ef-792e-43c5-a6e3-2dee2e561522 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:17.196074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068f3ef-792e-43c5-a6e3-2dee2e561522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:17.196667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068f3ef-792e-43c5-a6e3-2dee2e561522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:17.198323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068f3ef-792e-43c5-a6e3-2dee2e561522 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:17.205687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97722c-0ca0-4d4b-adf8-3b24ef29e313 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:17.217240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 483/977] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:17.218504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f3ef-792e-43c5-a6e3-2dee2e561522 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:17.241966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ddd5c-36ec-4b93-aa6a-44b5ec16c317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:17.242585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ddd5c-36ec-4b93-aa6a-44b5ec16c317 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:17.242865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ddd5c-36ec-4b93-aa6a-44b5ec16c317 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:17.243139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ddd5c-36ec-4b93-aa6a-44b5ec16c317 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:17.243976 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ddd5c-36ec-4b93-aa6a-44b5ec16c317 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:17.244283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ddd5c-36ec-4b93-aa6a-44b5ec16c317 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:17.245927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ddd5c-36ec-4b93-aa6a-44b5ec16c317 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:17.294157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 495/978] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Oct 6 04:20:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:17.336541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f3ef-792e-43c5-a6e3-2dee2e561522 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:17.379133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bedeb3-8373-4464-90c1-c6bd2a3feee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:17.380164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bedeb3-8373-4464-90c1-c6bd2a3feee4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:17.380649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bedeb3-8373-4464-90c1-c6bd2a3feee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:17.381131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bedeb3-8373-4464-90c1-c6bd2a3feee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:17.382108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bedeb3-8373-4464-90c1-c6bd2a3feee4 None admin] RBAC: Adding query filter params (role.id=cc4b0fb15df246e28abd425b2bb85d33, scope.project.id=e6bea894013f40638404395075ade90d, user.id=cdff0406366845169a481e3cd1188725) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:17.382623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bedeb3-8373-4464-90c1-c6bd2a3feee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:17.384420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bedeb3-8373-4464-90c1-c6bd2a3feee4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:17.391727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 484/979] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:20:17 2022] GET /identity/v3/role_assignments?user.id=cdff0406366845169a481e3cd1188725&scope.project.id=e6bea894013f40638404395075ade90d&role.id=cc4b0fb15df246e28abd425b2bb85d33 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:17.444794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef47c59-dfe0-4d63-b965-5a8160f18053 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:17.445135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef47c59-dfe0-4d63-b965-5a8160f18053 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:17.445348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef47c59-dfe0-4d63-b965-5a8160f18053 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:17.447113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 496/980] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:17.453682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb120a4-f854-4fb6-b8f1-1ff0a8604731 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:17.454019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb120a4-f854-4fb6-b8f1-1ff0a8604731 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:17.454214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb120a4-f854-4fb6-b8f1-1ff0a8604731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:17.462335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:17.475756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6cb120a4-f854-4fb6-b8f1-1ff0a8604731 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:17.476998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6cb120a4-f854-4fb6-b8f1-1ff0a8604731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:17.557732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 485/981] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:20:17.750281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bdad7-0401-4cfc-beb4-a7e8ae64ad66 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:17.750832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bdad7-0401-4cfc-beb4-a7e8ae64ad66 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:17.750832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bdad7-0401-4cfc-beb4-a7e8ae64ad66 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:17.752335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 497/982] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:17.757572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235ce68-6143-4ef4-9544-9c1b7d738131 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:17.757865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235ce68-6143-4ef4-9544-9c1b7d738131 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:17.758090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235ce68-6143-4ef4-9544-9c1b7d738131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:17.777141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7235ce68-6143-4ef4-9544-9c1b7d738131 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:17.778320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7235ce68-6143-4ef4-9544-9c1b7d738131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:17.828543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bdad7-0401-4cfc-beb4-a7e8ae64ad66 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:17.845558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:17.851381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 486/983] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:17.988685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bdad7-0401-4cfc-beb4-a7e8ae64ad66 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:18.044388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048c37-ad97-49ba-9ddf-13ca43d8296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:18.045480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048c37-ad97-49ba-9ddf-13ca43d8296c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:18.045849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048c37-ad97-49ba-9ddf-13ca43d8296c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:18.046315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048c37-ad97-49ba-9ddf-13ca43d8296c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:18.047339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048c37-ad97-49ba-9ddf-13ca43d8296c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:18.049781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048c37-ad97-49ba-9ddf-13ca43d8296c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7c048c37-ad97-49ba-9ddf-13ca43d8296c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:18.065077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:18.066072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:18.067782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 498/984] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:18.073645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235ce68-6143-4ef4-9544-9c1b7d738131 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:18.139576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:18.178368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235ce68-6143-4ef4-9544-9c1b7d738131 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:18.212819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81920eb1-88b2-443b-b74d-d3bb164af049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:18.213426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920eb1-88b2-443b-b74d-d3bb164af049 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:18.213699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920eb1-88b2-443b-b74d-d3bb164af049 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:18.213928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920eb1-88b2-443b-b74d-d3bb164af049 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:18.214563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81920eb1-88b2-443b-b74d-d3bb164af049 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:18.214865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81920eb1-88b2-443b-b74d-d3bb164af049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:18.216272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81920eb1-88b2-443b-b74d-d3bb164af049 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:18.221248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 487/985] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 6 04:20:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:18.226970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048c37-ad97-49ba-9ddf-13ca43d8296c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:18.229922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81920eb1-88b2-443b-b74d-d3bb164af049 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:18.313946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:18.340982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048c37-ad97-49ba-9ddf-13ca43d8296c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:18.356549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81920eb1-88b2-443b-b74d-d3bb164af049 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:18.379225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd4d8-c7a0-4ec0-adad-f5eb04e69612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:18.379853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd4d8-c7a0-4ec0-adad-f5eb04e69612 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:18.380138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd4d8-c7a0-4ec0-adad-f5eb04e69612 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:18.380388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd4d8-c7a0-4ec0-adad-f5eb04e69612 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:18.381008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd4d8-c7a0-4ec0-adad-f5eb04e69612 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:18.381304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd4d8-c7a0-4ec0-adad-f5eb04e69612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:18.382659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd4d8-c7a0-4ec0-adad-f5eb04e69612 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:18.385801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:18.392344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 499/986] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 6 04:20:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:18.394011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb4901-8504-4ead-847e-4b977a0e2aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:18.394305 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd4d8-c7a0-4ec0-adad-f5eb04e69612 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:18.394811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb4901-8504-4ead-847e-4b977a0e2aa2 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:18.395102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb4901-8504-4ead-847e-4b977a0e2aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:18.395642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb4901-8504-4ead-847e-4b977a0e2aa2 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:18.396545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb4901-8504-4ead-847e-4b977a0e2aa2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:18.397912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb4901-8504-4ead-847e-4b977a0e2aa2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:18.415142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 488/987] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:20:18 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:20:18.511973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd4d8-c7a0-4ec0-adad-f5eb04e69612 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:18.555930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d22dc-920f-4627-8d77-71bdc21b4bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:18.556545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d22dc-920f-4627-8d77-71bdc21b4bdf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:18.556818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d22dc-920f-4627-8d77-71bdc21b4bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:18.557079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d22dc-920f-4627-8d77-71bdc21b4bdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:18.557804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d22dc-920f-4627-8d77-71bdc21b4bdf None admin] RBAC: Adding query filter params (interface=admin, service_id=e7fe09d04f8e47eeb9dd5c5db4f787a5, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:18.558109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d22dc-920f-4627-8d77-71bdc21b4bdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:18.559542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d22dc-920f-4627-8d77-71bdc21b4bdf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:18.565971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 500/988] 10.222.0.20 () {56 vars in 1249 bytes} [Thu Oct 6 04:20:18 2022] GET /identity/v3/endpoints?service_id=e7fe09d04f8e47eeb9dd5c5db4f787a5&interface=admin®ion_id=RegionOne => generated 193 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:18.571680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb4901-8504-4ead-847e-4b977a0e2aa2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:18.679455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb4901-8504-4ead-847e-4b977a0e2aa2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:18.713849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884325d-b8d2-4881-8901-3de9717c10da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:18.714460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884325d-b8d2-4881-8901-3de9717c10da None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:18.714731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884325d-b8d2-4881-8901-3de9717c10da None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:18.714994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884325d-b8d2-4881-8901-3de9717c10da None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:18.715624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884325d-b8d2-4881-8901-3de9717c10da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:18.717043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884325d-b8d2-4881-8901-3de9717c10da None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:18.723424 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 489/989] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 6 04:20:18 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:20:19.594754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f296-c818-49bd-acb1-e1773336b5ab None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:19.595301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f296-c818-49bd-acb1-e1773336b5ab None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:19.595301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f296-c818-49bd-acb1-e1773336b5ab None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:19.596781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 501/990] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:19.602428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7084d3-8bcd-4324-89d9-e892432b9bed None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:19.602900 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7084d3-8bcd-4324-89d9-e892432b9bed None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:19.602900 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7084d3-8bcd-4324-89d9-e892432b9bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:19.622386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-da7084d3-8bcd-4324-89d9-e892432b9bed None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:19.623662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-da7084d3-8bcd-4324-89d9-e892432b9bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:19.673624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:19.699363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 490/991] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:19.962471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8f296-c818-49bd-acb1-e1773336b5ab None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:19.965593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:20.070350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8f296-c818-49bd-acb1-e1773336b5ab None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:20.103239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c48f9c-ae1f-45f1-9072-5f0ddd52c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:20.103893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c48f9c-ae1f-45f1-9072-5f0ddd52c047 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:20.104166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c48f9c-ae1f-45f1-9072-5f0ddd52c047 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:20.104430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c48f9c-ae1f-45f1-9072-5f0ddd52c047 None admin] PATH_INFO: `/v3/services/image` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:20.105010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c48f9c-ae1f-45f1-9072-5f0ddd52c047 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:20.106374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c48f9c-ae1f-45f1-9072-5f0ddd52c047 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f8c48f9c-ae1f-45f1-9072-5f0ddd52c047 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:20.115146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:20.116548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:20.117425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 502/992] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Oct 6 04:20:19 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:20.124603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7084d3-8bcd-4324-89d9-e892432b9bed None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:20.228518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7084d3-8bcd-4324-89d9-e892432b9bed None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:20.264365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f2672-8e3a-4988-8c2e-5bdd4c301523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:20.264980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2672-8e3a-4988-8c2e-5bdd4c301523 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:20.265250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2672-8e3a-4988-8c2e-5bdd4c301523 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:20.265514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2672-8e3a-4988-8c2e-5bdd4c301523 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:20.266135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f2672-8e3a-4988-8c2e-5bdd4c301523 None admin] RBAC: Adding query filter params (name=image) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:20.266427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f2672-8e3a-4988-8c2e-5bdd4c301523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:20.267838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f2672-8e3a-4988-8c2e-5bdd4c301523 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:20.277426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 491/993] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:20.279345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c48f9c-ae1f-45f1-9072-5f0ddd52c047 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:20.355412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:20.392791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c48f9c-ae1f-45f1-9072-5f0ddd52c047 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:20.427137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385266f-cfab-4b9b-b6c4-53736f9a2eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:20.427789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385266f-cfab-4b9b-b6c4-53736f9a2eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:20.428058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385266f-cfab-4b9b-b6c4-53736f9a2eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:20.428322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385266f-cfab-4b9b-b6c4-53736f9a2eb4 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:20.428958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385266f-cfab-4b9b-b6c4-53736f9a2eb4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:20.429247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385266f-cfab-4b9b-b6c4-53736f9a2eb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:20.430601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385266f-cfab-4b9b-b6c4-53736f9a2eb4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:20.435519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 503/994] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:20.611228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239d4c-3463-4425-bf13-0bf1e4c55f90 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:20.611756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239d4c-3463-4425-bf13-0bf1e4c55f90 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:20.611756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239d4c-3463-4425-bf13-0bf1e4c55f90 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:20.613076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 492/995] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:20.619292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9e2ac-d939-4279-99cb-46469f504290 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:20.619737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9e2ac-d939-4279-99cb-46469f504290 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:20.619908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9e2ac-d939-4279-99cb-46469f504290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:20.639542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4ec9e2ac-d939-4279-99cb-46469f504290 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:20.641095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4ec9e2ac-d939-4279-99cb-46469f504290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:20.710371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 504/996] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:20.869988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f29c02-753a-495d-aeea-f1ce65d37d36 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:20.870194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f29c02-753a-495d-aeea-f1ce65d37d36 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:20.870470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f29c02-753a-495d-aeea-f1ce65d37d36 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:20.872010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 493/997] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:20.877341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa5e5-ba63-4986-b4c5-2ccbcc4f8645 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:20.877617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa5e5-ba63-4986-b4c5-2ccbcc4f8645 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:20.877884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa5e5-ba63-4986-b4c5-2ccbcc4f8645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:20.897028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e92aa5e5-ba63-4986-b4c5-2ccbcc4f8645 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:20.898195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e92aa5e5-ba63-4986-b4c5-2ccbcc4f8645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:20.960040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:20.972939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 505/998] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:20.985379 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f29c02-753a-495d-aeea-f1ce65d37d36 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:21.036122 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:21.090923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f29c02-753a-495d-aeea-f1ce65d37d36 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:21.125920 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419456-b77f-429a-a33a-7ac66c53ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:21.126472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419456-b77f-429a-a33a-7ac66c53ca61 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:21.126746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419456-b77f-429a-a33a-7ac66c53ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:21.127013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419456-b77f-429a-a33a-7ac66c53ca61 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:21.127614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419456-b77f-429a-a33a-7ac66c53ca61 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:21.129020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419456-b77f-429a-a33a-7ac66c53ca61 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-02419456-b77f-429a-a33a-7ac66c53ca61 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:21.137848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:21.144102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:21.145034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 494/999] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:21.147478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aa5e5-ba63-4986-b4c5-2ccbcc4f8645 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:21.234795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419456-b77f-429a-a33a-7ac66c53ca61 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:21.252015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aa5e5-ba63-4986-b4c5-2ccbcc4f8645 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:21.288979 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba9dda-10f2-4b1b-8539-b6ba6f51a221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:21.289877 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba9dda-10f2-4b1b-8539-b6ba6f51a221 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:21.290161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba9dda-10f2-4b1b-8539-b6ba6f51a221 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:21.290430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba9dda-10f2-4b1b-8539-b6ba6f51a221 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:21.291066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba9dda-10f2-4b1b-8539-b6ba6f51a221 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:21.291395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba9dda-10f2-4b1b-8539-b6ba6f51a221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:21.293190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba9dda-10f2-4b1b-8539-b6ba6f51a221 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:21.302804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 506/1000] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:20:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:21.306655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba9dda-10f2-4b1b-8539-b6ba6f51a221 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:21.352003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419456-b77f-429a-a33a-7ac66c53ca61 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:21.363089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:21.372356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:21.388201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481bd0c-9a68-4c71-b0d0-66d0234553bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:21.390014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481bd0c-9a68-4c71-b0d0-66d0234553bf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:21.390300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481bd0c-9a68-4c71-b0d0-66d0234553bf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:21.390567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481bd0c-9a68-4c71-b0d0-66d0234553bf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:21.391146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481bd0c-9a68-4c71-b0d0-66d0234553bf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:21.392571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481bd0c-9a68-4c71-b0d0-66d0234553bf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-8481bd0c-9a68-4c71-b0d0-66d0234553bf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:21.402479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:21.403632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:21.404572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 495/1001] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Oct 6 04:20:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:21.409518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481bd0c-9a68-4c71-b0d0-66d0234553bf None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:21.421274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba9dda-10f2-4b1b-8539-b6ba6f51a221 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:21.459533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609dabf-4f83-4e33-9dae-f9e3ab115e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:21.460289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609dabf-4f83-4e33-9dae-f9e3ab115e8e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:21.460837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609dabf-4f83-4e33-9dae-f9e3ab115e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:21.461113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609dabf-4f83-4e33-9dae-f9e3ab115e8e None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:21.461732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609dabf-4f83-4e33-9dae-f9e3ab115e8e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:21.462030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609dabf-4f83-4e33-9dae-f9e3ab115e8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:21.463823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609dabf-4f83-4e33-9dae-f9e3ab115e8e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:21.468784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 507/1002] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:20:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:21.474684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609dabf-4f83-4e33-9dae-f9e3ab115e8e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:21.513024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481bd0c-9a68-4c71-b0d0-66d0234553bf None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:21.546993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3c134-751d-4118-85fb-dd190d762265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:21.547648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3c134-751d-4118-85fb-dd190d762265 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:21.547923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3c134-751d-4118-85fb-dd190d762265 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:21.548192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3c134-751d-4118-85fb-dd190d762265 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:21.548830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3c134-751d-4118-85fb-dd190d762265 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:21.549127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3c134-751d-4118-85fb-dd190d762265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:21.550490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3c134-751d-4118-85fb-dd190d762265 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:21.560075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 496/1003] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 6 04:20:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:21.560801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3c134-751d-4118-85fb-dd190d762265 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:21.579440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609dabf-4f83-4e33-9dae-f9e3ab115e8e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:21.599227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:21.600460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:21.619664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9f49b-97ac-4aef-b7fb-a6e2adf5a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:21.620311 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f49b-97ac-4aef-b7fb-a6e2adf5a8ff None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:21.620548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f49b-97ac-4aef-b7fb-a6e2adf5a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:21.620812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f49b-97ac-4aef-b7fb-a6e2adf5a8ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:21.621513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9f49b-97ac-4aef-b7fb-a6e2adf5a8ff None admin] RBAC: Adding query filter params (interface=public, service_id=17b1894db0fe462c9cfd00c7ae42e80e, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:21.621819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9f49b-97ac-4aef-b7fb-a6e2adf5a8ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:21.623268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9f49b-97ac-4aef-b7fb-a6e2adf5a8ff None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:21.628583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 508/1004] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 6 04:20:21 2022] GET /identity/v3/endpoints?service_id=17b1894db0fe462c9cfd00c7ae42e80e&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:21.633957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9f49b-97ac-4aef-b7fb-a6e2adf5a8ff None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:21.664731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3c134-751d-4118-85fb-dd190d762265 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:21.706072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709084a-0ac4-4b46-814f-fa87f2d997b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:21.706681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709084a-0ac4-4b46-814f-fa87f2d997b6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:21.706960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709084a-0ac4-4b46-814f-fa87f2d997b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:21.707221 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709084a-0ac4-4b46-814f-fa87f2d997b6 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:21.707921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709084a-0ac4-4b46-814f-fa87f2d997b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:21.708227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709084a-0ac4-4b46-814f-fa87f2d997b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:21.709596 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709084a-0ac4-4b46-814f-fa87f2d997b6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:21.714644 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 497/1005] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Oct 6 04:20:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:21.720382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709084a-0ac4-4b46-814f-fa87f2d997b6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:21.746447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9f49b-97ac-4aef-b7fb-a6e2adf5a8ff None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:21.784324 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa06640-6bb0-417e-9a6c-5c57b4b73191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:21.785089 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa06640-6bb0-417e-9a6c-5c57b4b73191 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:21.785683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa06640-6bb0-417e-9a6c-5c57b4b73191 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:21.785984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa06640-6bb0-417e-9a6c-5c57b4b73191 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:21.786865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa06640-6bb0-417e-9a6c-5c57b4b73191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:21.788232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa06640-6bb0-417e-9a6c-5c57b4b73191 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:21.795763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 509/1006] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 6 04:20:21 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:20:21.835997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709084a-0ac4-4b46-814f-fa87f2d997b6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:21.838123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:21.878024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbaf71-1526-40ca-b833-8b0767959592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:21.879039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbaf71-1526-40ca-b833-8b0767959592 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:21.879548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbaf71-1526-40ca-b833-8b0767959592 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:21.880148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbaf71-1526-40ca-b833-8b0767959592 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:21.881026 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbaf71-1526-40ca-b833-8b0767959592 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:21.882713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbaf71-1526-40ca-b833-8b0767959592 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:21.911355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 498/1007] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:20:21 2022] POST /identity/v3/endpoints => generated 325 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:20:22.611219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5fa2-c09c-4e5a-8b8b-4d57ab494deb None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:22.611620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5fa2-c09c-4e5a-8b8b-4d57ab494deb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:22.611795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5fa2-c09c-4e5a-8b8b-4d57ab494deb None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:22.613168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 510/1008] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:22.619005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327ccc5-05a0-4212-8d7c-a8397b5119ca None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:22.619292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327ccc5-05a0-4212-8d7c-a8397b5119ca None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:22.619589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327ccc5-05a0-4212-8d7c-a8397b5119ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:22.638039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b327ccc5-05a0-4212-8d7c-a8397b5119ca None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:22.639358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b327ccc5-05a0-4212-8d7c-a8397b5119ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:22.715115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 499/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:22.977628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c5fa2-c09c-4e5a-8b8b-4d57ab494deb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:23.031643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:23.090164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c5fa2-c09c-4e5a-8b8b-4d57ab494deb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:23.126787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65ed2d-0401-433d-a041-ae10eac03021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:23.127426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ed2d-0401-433d-a041-ae10eac03021 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:23.127705 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ed2d-0401-433d-a041-ae10eac03021 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:23.127980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ed2d-0401-433d-a041-ae10eac03021 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:23.128746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65ed2d-0401-433d-a041-ae10eac03021 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:23.130106 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65ed2d-0401-433d-a041-ae10eac03021 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:23.147380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 511/1010] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:20:22 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:20:23.955565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cacd2-be1f-493b-84e7-89790ee44ba6 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:23.956118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cacd2-be1f-493b-84e7-89790ee44ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:23.956118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cacd2-be1f-493b-84e7-89790ee44ba6 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:23.957821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 500/1011] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:23.963825 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3a7bf-b703-483b-a351-3e4fdd1e054c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:23.964157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3a7bf-b703-483b-a351-3e4fdd1e054c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:23.964376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3a7bf-b703-483b-a351-3e4fdd1e054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:23.984948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5ef3a7bf-b703-483b-a351-3e4fdd1e054c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:23.986176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5ef3a7bf-b703-483b-a351-3e4fdd1e054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:24.069142 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 512/1012] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:23 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:24.076808 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ade6d2-40cd-4358-9cb9-8a3c23975e6f None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:24.077075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ade6d2-40cd-4358-9cb9-8a3c23975e6f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:24.077360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ade6d2-40cd-4358-9cb9-8a3c23975e6f None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:24.078842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 501/1013] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:24.084025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e03da2-041d-4bfe-bcaa-febb6022613e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:24.084308 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e03da2-041d-4bfe-bcaa-febb6022613e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:24.084535 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e03da2-041d-4bfe-bcaa-febb6022613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:24.103090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c6e03da2-041d-4bfe-bcaa-febb6022613e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:24.104304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c6e03da2-041d-4bfe-bcaa-febb6022613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:24.130741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:24.175263 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 513/1014] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:24 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:24.334642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ade6d2-40cd-4358-9cb9-8a3c23975e6f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:24.431638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:24.438544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e03da2-041d-4bfe-bcaa-febb6022613e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:24.451541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ade6d2-40cd-4358-9cb9-8a3c23975e6f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:24.488828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3675-71c4-4309-b4ba-d9f5b70e55e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:24.489460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3675-71c4-4309-b4ba-d9f5b70e55e4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:24.489738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3675-71c4-4309-b4ba-d9f5b70e55e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:24.490008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3675-71c4-4309-b4ba-d9f5b70e55e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:24.490582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd3675-71c4-4309-b4ba-d9f5b70e55e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:24.492395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd3675-71c4-4309-b4ba-d9f5b70e55e4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b8cd3675-71c4-4309-b4ba-d9f5b70e55e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:24.501141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:24.502177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:24.503078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 502/1015] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:24.508048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3675-71c4-4309-b4ba-d9f5b70e55e4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:24.553628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e03da2-041d-4bfe-bcaa-febb6022613e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:24.587235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8c262-4ace-4d85-b3f2-b621cb1854b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:24.587823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8c262-4ace-4d85-b3f2-b621cb1854b9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:24.588325 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8c262-4ace-4d85-b3f2-b621cb1854b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:24.588448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8c262-4ace-4d85-b3f2-b621cb1854b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:24.589651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8c262-4ace-4d85-b3f2-b621cb1854b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:24.590879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8c262-4ace-4d85-b3f2-b621cb1854b9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:24.592738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 514/1016] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:24.598235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8c262-4ace-4d85-b3f2-b621cb1854b9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:24.613766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3675-71c4-4309-b4ba-d9f5b70e55e4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:24.631040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:24.658575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3076ace-c6b8-4f5a-9dc5-e59d19e5e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:24.659785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3076ace-c6b8-4f5a-9dc5-e59d19e5e156 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:24.660284 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3076ace-c6b8-4f5a-9dc5-e59d19e5e156 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:24.660953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3076ace-c6b8-4f5a-9dc5-e59d19e5e156 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:24.662373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3076ace-c6b8-4f5a-9dc5-e59d19e5e156 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:24.662873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3076ace-c6b8-4f5a-9dc5-e59d19e5e156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:24.665318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3076ace-c6b8-4f5a-9dc5-e59d19e5e156 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:24.675298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 503/1017] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:20:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:24.676360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3076ace-c6b8-4f5a-9dc5-e59d19e5e156 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:24.695082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:24.711154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8c262-4ace-4d85-b3f2-b621cb1854b9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:24.751174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e849-a123-4a8c-90eb-f4d44b07c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:24.751819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e849-a123-4a8c-90eb-f4d44b07c6ce None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:24.752096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e849-a123-4a8c-90eb-f4d44b07c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:24.752364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e849-a123-4a8c-90eb-f4d44b07c6ce None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:24.753012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456e849-a123-4a8c-90eb-f4d44b07c6ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:24.754437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456e849-a123-4a8c-90eb-f4d44b07c6ce None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:24.780433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3076ace-c6b8-4f5a-9dc5-e59d19e5e156 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:24.783854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 515/1018] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:20:24 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:20:24.818626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570df66-8650-4694-a6e0-5f30aad1c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:24.819259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570df66-8650-4694-a6e0-5f30aad1c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:24.819577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570df66-8650-4694-a6e0-5f30aad1c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:24.819849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570df66-8650-4694-a6e0-5f30aad1c0a5 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:24.820484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570df66-8650-4694-a6e0-5f30aad1c0a5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:24.820812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570df66-8650-4694-a6e0-5f30aad1c0a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:24.822228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570df66-8650-4694-a6e0-5f30aad1c0a5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:24.828747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 504/1019] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Oct 6 04:20:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:24.834464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e849-a123-4a8c-90eb-f4d44b07c6ce None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:24.930344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:24.954937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e849-a123-4a8c-90eb-f4d44b07c6ce None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:24.994403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad8cc4-b65a-4acb-af6f-6993409f4d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:24.995741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad8cc4-b65a-4acb-af6f-6993409f4d6b None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:24.996169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad8cc4-b65a-4acb-af6f-6993409f4d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:24.996439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad8cc4-b65a-4acb-af6f-6993409f4d6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:24.997120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad8cc4-b65a-4acb-af6f-6993409f4d6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:24.998488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad8cc4-b65a-4acb-af6f-6993409f4d6b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:25.019138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 516/1020] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:20:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:20:25.336723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cd4a0-e783-4db4-bf40-de34ced7e813 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:25.337264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cd4a0-e783-4db4-bf40-de34ced7e813 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:25.337264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cd4a0-e783-4db4-bf40-de34ced7e813 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:25.338743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 505/1021] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:25.344139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14c9e-a945-4d09-9208-42241b402350 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:25.344427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14c9e-a945-4d09-9208-42241b402350 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:25.344700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14c9e-a945-4d09-9208-42241b402350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:25.363082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-69c14c9e-a945-4d09-9208-42241b402350 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:25.364299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-69c14c9e-a945-4d09-9208-42241b402350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:25.442095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 517/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:25.704319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cd4a0-e783-4db4-bf40-de34ced7e813 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:25.789528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:25.811233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cd4a0-e783-4db4-bf40-de34ced7e813 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:25.847034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e39fc-44ef-4ede-8e96-13ad31d27ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:25.847692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e39fc-44ef-4ede-8e96-13ad31d27ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:25.847964 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e39fc-44ef-4ede-8e96-13ad31d27ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:25.848230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e39fc-44ef-4ede-8e96-13ad31d27ec1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:25.848859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e39fc-44ef-4ede-8e96-13ad31d27ec1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:25.850291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e39fc-44ef-4ede-8e96-13ad31d27ec1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b75e39fc-44ef-4ede-8e96-13ad31d27ec1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:25.859527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:25.860511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 04:20:25.861461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:25.863107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 506/1023] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Oct 6 04:20:25 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:25.867072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c14c9e-a945-4d09-9208-42241b402350 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:25.928252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:25.969520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c14c9e-a945-4d09-9208-42241b402350 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:26.010430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee41f78-da1d-4e8a-9f00-7f626d42c15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:26.011120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee41f78-da1d-4e8a-9f00-7f626d42c15c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:26.011376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee41f78-da1d-4e8a-9f00-7f626d42c15c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:26.011604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee41f78-da1d-4e8a-9f00-7f626d42c15c None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:26.012237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee41f78-da1d-4e8a-9f00-7f626d42c15c None admin] RBAC: Adding query filter params (name=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:26.012537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee41f78-da1d-4e8a-9f00-7f626d42c15c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:26.013936 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee41f78-da1d-4e8a-9f00-7f626d42c15c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:26.025468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 518/1024] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:26.025636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e39fc-44ef-4ede-8e96-13ad31d27ec1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:26.133204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e39fc-44ef-4ede-8e96-13ad31d27ec1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:26.167162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46114990-fabb-4926-ac6d-e3adb65c9e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:26.167824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46114990-fabb-4926-ac6d-e3adb65c9e42 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:26.168096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46114990-fabb-4926-ac6d-e3adb65c9e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:26.168360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46114990-fabb-4926-ac6d-e3adb65c9e42 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:26.168981 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46114990-fabb-4926-ac6d-e3adb65c9e42 None admin] RBAC: Adding query filter params (type=image) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:26.169271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46114990-fabb-4926-ac6d-e3adb65c9e42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:26.170685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46114990-fabb-4926-ac6d-e3adb65c9e42 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:26.181084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 507/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:26.182319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee41f78-da1d-4e8a-9f00-7f626d42c15c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:26.281697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee41f78-da1d-4e8a-9f00-7f626d42c15c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:26.311659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:26.324383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859cdf3-745b-47a0-a0f6-15946f1fa70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:26.324903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859cdf3-745b-47a0-a0f6-15946f1fa70a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:26.325141 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859cdf3-745b-47a0-a0f6-15946f1fa70a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:26.325424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859cdf3-745b-47a0-a0f6-15946f1fa70a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:26.326222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859cdf3-745b-47a0-a0f6-15946f1fa70a None admin] RBAC: Adding query filter params (interface=public, service_id=9c1c94d6b6b240ed80d5961e0c37a133, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:26.326682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859cdf3-745b-47a0-a0f6-15946f1fa70a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:26.328169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859cdf3-745b-47a0-a0f6-15946f1fa70a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:26.334105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 519/1026] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 6 04:20:26 2022] GET /identity/v3/endpoints?service_id=9c1c94d6b6b240ed80d5961e0c37a133&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:26.339962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46114990-fabb-4926-ac6d-e3adb65c9e42 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:26.352891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:26.442945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46114990-fabb-4926-ac6d-e3adb65c9e42 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:26.475847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4423c2-e9c1-4232-aa81-77abf020bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:26.476470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4423c2-e9c1-4232-aa81-77abf020bff4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:26.476747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4423c2-e9c1-4232-aa81-77abf020bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:26.476994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4423c2-e9c1-4232-aa81-77abf020bff4 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:26.477597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4423c2-e9c1-4232-aa81-77abf020bff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:26.478959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4423c2-e9c1-4232-aa81-77abf020bff4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:26.485739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 508/1027] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 6 04:20:26 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:20:27.047152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32642-1054-4a7d-935c-d5371dd5f41d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:27.047743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32642-1054-4a7d-935c-d5371dd5f41d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:27.047743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32642-1054-4a7d-935c-d5371dd5f41d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:27.049052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 520/1028] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:27.054831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6b3c0-01a0-4686-bd26-5893f8c90e6d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:27.055183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6b3c0-01a0-4686-bd26-5893f8c90e6d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:27.055545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6b3c0-01a0-4686-bd26-5893f8c90e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:27.075231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1bf6b3c0-01a0-4686-bd26-5893f8c90e6d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:27.076574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1bf6b3c0-01a0-4686-bd26-5893f8c90e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:27.147658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 509/1029] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:27.267353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df4eb-d26c-4258-a930-23e71729127d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:27.267726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df4eb-d26c-4258-a930-23e71729127d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:27.267895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df4eb-d26c-4258-a930-23e71729127d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:27.269393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 521/1030] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:27.274496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c338d-84d6-4473-93fc-e2aaa6b2acb7 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:27.274754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c338d-84d6-4473-93fc-e2aaa6b2acb7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:27.275033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c338d-84d6-4473-93fc-e2aaa6b2acb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:27.281756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:27.295636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8d9c338d-84d6-4473-93fc-e2aaa6b2acb7 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:27.297079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8d9c338d-84d6-4473-93fc-e2aaa6b2acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:27.375528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 510/1031] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:27.417117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9df4eb-d26c-4258-a930-23e71729127d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:27.522997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9df4eb-d26c-4258-a930-23e71729127d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:27.557211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8db5a-8830-493c-b346-687628d3df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:27.558112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8db5a-8830-493c-b346-687628d3df75 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:27.558385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8db5a-8830-493c-b346-687628d3df75 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:27.558651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8db5a-8830-493c-b346-687628d3df75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:27.559903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8db5a-8830-493c-b346-687628d3df75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:27.561831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8db5a-8830-493c-b346-687628d3df75 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:27.563741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 522/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:27.569440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c338d-84d6-4473-93fc-e2aaa6b2acb7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:27.643907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8db5a-8830-493c-b346-687628d3df75 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:27.675976 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c338d-84d6-4473-93fc-e2aaa6b2acb7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:27.707300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:27.707724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:27.713754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44afbd-951d-4217-9272-d0191ac71ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:27.714916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44afbd-951d-4217-9272-d0191ac71ec0 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:27.715405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44afbd-951d-4217-9272-d0191ac71ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:27.715864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44afbd-951d-4217-9272-d0191ac71ec0 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:27.716283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44afbd-951d-4217-9272-d0191ac71ec0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:27.717935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44afbd-951d-4217-9272-d0191ac71ec0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:27.745483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 511/1033] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:20:27 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:20:27.755569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8db5a-8830-493c-b346-687628d3df75 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:27.790871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0186bf-9416-4a41-9993-72659d8de80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:27.791561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0186bf-9416-4a41-9993-72659d8de80c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:27.791841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0186bf-9416-4a41-9993-72659d8de80c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:27.792103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0186bf-9416-4a41-9993-72659d8de80c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:27.804138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0186bf-9416-4a41-9993-72659d8de80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8a0186bf-9416-4a41-9993-72659d8de80c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:20:27.809203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:27.810220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:27.811120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:27.815793 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 523/1034] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 6 04:20:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:27.817233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44afbd-951d-4217-9272-d0191ac71ec0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:27.925723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44afbd-951d-4217-9272-d0191ac71ec0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:27.963102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a92da4-3431-43f9-b8e2-d8376179c07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:27.963782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a92da4-3431-43f9-b8e2-d8376179c07e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:27.964051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a92da4-3431-43f9-b8e2-d8376179c07e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:27.964334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a92da4-3431-43f9-b8e2-d8376179c07e None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:27.964998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a92da4-3431-43f9-b8e2-d8376179c07e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:27.965278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a92da4-3431-43f9-b8e2-d8376179c07e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:27.966687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a92da4-3431-43f9-b8e2-d8376179c07e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:27.976084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 512/1035] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 6 04:20:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:27.982465 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0186bf-9416-4a41-9993-72659d8de80c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:28.086676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0186bf-9416-4a41-9993-72659d8de80c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:28.108369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:28.125783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a05e1e-f376-417f-8fd8-2e2f856fdd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:28.126417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05e1e-f376-417f-8fd8-2e2f856fdd5b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:28.126687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05e1e-f376-417f-8fd8-2e2f856fdd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:28.126950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05e1e-f376-417f-8fd8-2e2f856fdd5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:28.137735 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a05e1e-f376-417f-8fd8-2e2f856fdd5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:28.139211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a05e1e-f376-417f-8fd8-2e2f856fdd5b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-69a05e1e-f376-417f-8fd8-2e2f856fdd5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:28.154878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:28.156038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:28.161803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:28.161803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:28.161803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:28.161803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 524/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:28.163839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a92da4-3431-43f9-b8e2-d8376179c07e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:28.217788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:28.271350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a92da4-3431-43f9-b8e2-d8376179c07e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:28.310935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a60cd-d82e-46fa-bd1c-a1c4de492187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:28.311574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a60cd-d82e-46fa-bd1c-a1c4de492187 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:28.311843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a60cd-d82e-46fa-bd1c-a1c4de492187 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:28.312107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a60cd-d82e-46fa-bd1c-a1c4de492187 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:28.315114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a60cd-d82e-46fa-bd1c-a1c4de492187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:28.315114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a60cd-d82e-46fa-bd1c-a1c4de492187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:28.315114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a60cd-d82e-46fa-bd1c-a1c4de492187 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:28.329585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 513/1037] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:28.335708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a05e1e-f376-417f-8fd8-2e2f856fdd5b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:28.447713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a05e1e-f376-417f-8fd8-2e2f856fdd5b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:28.483862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b971e8-f57a-4b42-a03f-f49398e2d251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:28.484404 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b971e8-f57a-4b42-a03f-f49398e2d251 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:28.484692 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b971e8-f57a-4b42-a03f-f49398e2d251 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:28.484928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b971e8-f57a-4b42-a03f-f49398e2d251 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:28.493360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b971e8-f57a-4b42-a03f-f49398e2d251 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:28.494758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b971e8-f57a-4b42-a03f-f49398e2d251 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-07b971e8-f57a-4b42-a03f-f49398e2d251 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:20:28.506981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:28.508011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:28.508985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:28.508985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:28.508985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:20:28.508985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:20:28.508985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:20:28.508985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:20:28.508985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:20:28.508985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:20:28.508985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:20:28.508985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:28.511398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 525/1038] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 6 04:20:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:28.514461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a60cd-d82e-46fa-bd1c-a1c4de492187 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:28.626827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a60cd-d82e-46fa-bd1c-a1c4de492187 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:28.638886 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:28.659835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8b944-8612-45e4-a172-837eb40f65b6 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:28.660103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8b944-8612-45e4-a172-837eb40f65b6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:28.660378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8b944-8612-45e4-a172-837eb40f65b6 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:28.661859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 526/1039] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:20:28.666194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7105d8f-832d-4093-bc38-2486cd63d2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:28.666515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138dca-bab4-45ee-a9c0-fa62ed329353 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:28.666802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138dca-bab4-45ee-a9c0-fa62ed329353 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:28.666908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7105d8f-832d-4093-bc38-2486cd63d2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:28.667069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7105d8f-832d-4093-bc38-2486cd63d2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:28.667163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138dca-bab4-45ee-a9c0-fa62ed329353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:28.667347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7105d8f-832d-4093-bc38-2486cd63d2b3 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:28.668130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7105d8f-832d-4093-bc38-2486cd63d2b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:28.668428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7105d8f-832d-4093-bc38-2486cd63d2b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:28.670115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7105d8f-832d-4093-bc38-2486cd63d2b3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:28.685697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-06138dca-bab4-45ee-a9c0-fa62ed329353 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:28.686887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-06138dca-bab4-45ee-a9c0-fa62ed329353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:28.689123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 514/1040] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 6 04:20:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:28.694440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7105d8f-832d-4093-bc38-2486cd63d2b3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:28.717703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:28.775536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 527/1041] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:20:28.806536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7105d8f-832d-4093-bc38-2486cd63d2b3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:28.843406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe346b5-72c8-4647-81c6-2b2f8781bdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:28.844015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe346b5-72c8-4647-81c6-2b2f8781bdea None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:28.844287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe346b5-72c8-4647-81c6-2b2f8781bdea None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:28.844557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe346b5-72c8-4647-81c6-2b2f8781bdea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:28.880844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:28.916907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe346b5-72c8-4647-81c6-2b2f8781bdea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:28.918366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe346b5-72c8-4647-81c6-2b2f8781bdea None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:29.020384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 515/1042] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:20:28 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 04:20:29.026174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06138dca-bab4-45ee-a9c0-fa62ed329353 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:29.030591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe346b5-72c8-4647-81c6-2b2f8781bdea None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:29.097165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:29.133859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe346b5-72c8-4647-81c6-2b2f8781bdea None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:29.137105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06138dca-bab4-45ee-a9c0-fa62ed329353 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:29.167291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0f46b-8193-437a-b54b-6c5f9effacd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:29.167955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0f46b-8193-437a-b54b-6c5f9effacd8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:29.168227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0f46b-8193-437a-b54b-6c5f9effacd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:29.168496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0f46b-8193-437a-b54b-6c5f9effacd8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:29.169085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0f46b-8193-437a-b54b-6c5f9effacd8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:29.170733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0f46b-8193-437a-b54b-6c5f9effacd8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:29.175361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bd702-36fb-4256-aa23-09921ce7544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:29.176000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bd702-36fb-4256-aa23-09921ce7544a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:29.176277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bd702-36fb-4256-aa23-09921ce7544a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:29.176543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bd702-36fb-4256-aa23-09921ce7544a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4df0f46b-8193-437a-b54b-6c5f9effacd8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:29.179528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:29.180504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 04:20:29.181355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:29.185626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 516/1043] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Oct 6 04:20:29 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:29.186430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0f46b-8193-437a-b54b-6c5f9effacd8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:29.187400 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bd702-36fb-4256-aa23-09921ce7544a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:29.188806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bd702-36fb-4256-aa23-09921ce7544a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ad8bd702-36fb-4256-aa23-09921ce7544a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:29.204815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:29.205805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:29.206717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:29.206717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:29.206717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:29.206717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 528/1044] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:29.211452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bd702-36fb-4256-aa23-09921ce7544a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:29.228594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:29.296828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0f46b-8193-437a-b54b-6c5f9effacd8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:29.323630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bd702-36fb-4256-aa23-09921ce7544a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:29.329034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:29.334809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb8cca-b2a7-4dd8-b016-c23e33cfd014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:29.335448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb8cca-b2a7-4dd8-b016-c23e33cfd014 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:29.335724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb8cca-b2a7-4dd8-b016-c23e33cfd014 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:29.335990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb8cca-b2a7-4dd8-b016-c23e33cfd014 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:29.336614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb8cca-b2a7-4dd8-b016-c23e33cfd014 None admin] RBAC: Adding query filter params (name=image) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:29.336916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb8cca-b2a7-4dd8-b016-c23e33cfd014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:29.338303 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb8cca-b2a7-4dd8-b016-c23e33cfd014 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:29.343187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 517/1045] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:29.348894 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb8cca-b2a7-4dd8-b016-c23e33cfd014 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:29.365520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdfbce-acfc-4dac-9ba6-8fedf69eccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:29.366575 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdfbce-acfc-4dac-9ba6-8fedf69eccd4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:29.366905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdfbce-acfc-4dac-9ba6-8fedf69eccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:29.367189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdfbce-acfc-4dac-9ba6-8fedf69eccd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:29.367859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdfbce-acfc-4dac-9ba6-8fedf69eccd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:29.368157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdfbce-acfc-4dac-9ba6-8fedf69eccd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:29.369509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdfbce-acfc-4dac-9ba6-8fedf69eccd4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:29.381993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 529/1046] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:29.387641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdfbce-acfc-4dac-9ba6-8fedf69eccd4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:29.458613 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb8cca-b2a7-4dd8-b016-c23e33cfd014 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:29.469965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:29.494460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd0dc4-f329-4f21-8a24-5d3a00e520d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:29.495078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0dc4-f329-4f21-8a24-5d3a00e520d3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:29.495381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0dc4-f329-4f21-8a24-5d3a00e520d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:29.495656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0dc4-f329-4f21-8a24-5d3a00e520d3 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:29.496291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd0dc4-f329-4f21-8a24-5d3a00e520d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:29.496591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd0dc4-f329-4f21-8a24-5d3a00e520d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:29.498294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd0dc4-f329-4f21-8a24-5d3a00e520d3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:29.498648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdfbce-acfc-4dac-9ba6-8fedf69eccd4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:29.508074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 518/1047] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:29.509033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd0dc4-f329-4f21-8a24-5d3a00e520d3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:29.535460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d1db0-d2fd-4f84-93c4-839a5e2f0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:29.536097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1db0-d2fd-4f84-93c4-839a5e2f0bcb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:29.536537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1db0-d2fd-4f84-93c4-839a5e2f0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:29.536807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1db0-d2fd-4f84-93c4-839a5e2f0bcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:29.544326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d1db0-d2fd-4f84-93c4-839a5e2f0bcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:29.545891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d1db0-d2fd-4f84-93c4-839a5e2f0bcb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e71d1db0-d2fd-4f84-93c4-839a5e2f0bcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:20:29.557218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:29.558122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:29.559047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:20:29.559047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:20:29.559047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:20:29.559047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:20:29.559047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:20:29.559047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:20:29.559047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:29.559047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:29.559047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 530/1048] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:29.564100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d1db0-d2fd-4f84-93c4-839a5e2f0bcb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:29.574653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:29.620394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd0dc4-f329-4f21-8a24-5d3a00e520d3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:29.654837 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c794c9-d4e7-47af-af45-c7d37238df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:29.655485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c794c9-d4e7-47af-af45-c7d37238df30 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:29.655763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c794c9-d4e7-47af-af45-c7d37238df30 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:29.656033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c794c9-d4e7-47af-af45-c7d37238df30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:29.656703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c794c9-d4e7-47af-af45-c7d37238df30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:29.658078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c794c9-d4e7-47af-af45-c7d37238df30 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:29.671666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d1db0-d2fd-4f84-93c4-839a5e2f0bcb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:29.679763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 519/1049] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:20:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:20:29.719600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:29.727201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1edbdc-55b5-441a-a1b1-371c547659f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:29.727879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1edbdc-55b5-441a-a1b1-371c547659f4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:29.728163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1edbdc-55b5-441a-a1b1-371c547659f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:29.728431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1edbdc-55b5-441a-a1b1-371c547659f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:29.729135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1edbdc-55b5-441a-a1b1-371c547659f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:29.729444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1edbdc-55b5-441a-a1b1-371c547659f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:29.731286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1edbdc-55b5-441a-a1b1-371c547659f4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:29.745640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 531/1050] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:20:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:29.752067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c794c9-d4e7-47af-af45-c7d37238df30 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:29.863940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c794c9-d4e7-47af-af45-c7d37238df30 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:29.881750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:29.905391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f667869-f515-40fa-ba85-e3071d0ce5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:29.905998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f667869-f515-40fa-ba85-e3071d0ce5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:29.906274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f667869-f515-40fa-ba85-e3071d0ce5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:29.906553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f667869-f515-40fa-ba85-e3071d0ce5f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:29.907346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f667869-f515-40fa-ba85-e3071d0ce5f1 None admin] RBAC: Adding query filter params (role.id=cc4b0fb15df246e28abd425b2bb85d33, scope.project.id=e6bea894013f40638404395075ade90d, user.id=0481d4c0be0b46189e339d1e00bee4c0) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:29.907653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f667869-f515-40fa-ba85-e3071d0ce5f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:29.909099 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f667869-f515-40fa-ba85-e3071d0ce5f1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:29.915345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 520/1051] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:20:29 2022] GET /identity/v3/role_assignments?user.id=0481d4c0be0b46189e339d1e00bee4c0&scope.project.id=e6bea894013f40638404395075ade90d&role.id=cc4b0fb15df246e28abd425b2bb85d33 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:30.056647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f585a-9951-4f24-8857-62bd75e89a94 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:30.057011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f585a-9951-4f24-8857-62bd75e89a94 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:30.057228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f585a-9951-4f24-8857-62bd75e89a94 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:30.058853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 532/1052] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:30.065345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf55fbf-31fb-4a3f-8c3b-e15cd9458261 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:30.065691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf55fbf-31fb-4a3f-8c3b-e15cd9458261 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:30.066082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf55fbf-31fb-4a3f-8c3b-e15cd9458261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:30.086306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-fbf55fbf-31fb-4a3f-8c3b-e15cd9458261 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:30.087546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fbf55fbf-31fb-4a3f-8c3b-e15cd9458261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:30.156292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 521/1053] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:30.420059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f585a-9951-4f24-8857-62bd75e89a94 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:30.526409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f585a-9951-4f24-8857-62bd75e89a94 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:30.560113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a94ea-c50c-440a-acbd-4c25d9d8935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:30.560797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a94ea-c50c-440a-acbd-4c25d9d8935a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:30.561068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a94ea-c50c-440a-acbd-4c25d9d8935a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:30.561329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a94ea-c50c-440a-acbd-4c25d9d8935a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:30.571328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a94ea-c50c-440a-acbd-4c25d9d8935a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e37a94ea-c50c-440a-acbd-4c25d9d8935a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:20:30.576288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:30.577227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:20:30.578077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:30.579393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 533/1054] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:20:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:30.583845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf55fbf-31fb-4a3f-8c3b-e15cd9458261 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:30.683499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf55fbf-31fb-4a3f-8c3b-e15cd9458261 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:30.694202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:30.718654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fff70-afe5-4ffa-b162-70952fba3b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:30.719260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fff70-afe5-4ffa-b162-70952fba3b77 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:30.719554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fff70-afe5-4ffa-b162-70952fba3b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:30.719815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fff70-afe5-4ffa-b162-70952fba3b77 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:30.720474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fff70-afe5-4ffa-b162-70952fba3b77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:30.720767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fff70-afe5-4ffa-b162-70952fba3b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:30.722131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fff70-afe5-4ffa-b162-70952fba3b77 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:30.730335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 522/1055] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:30.737001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a94ea-c50c-440a-acbd-4c25d9d8935a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:30.789381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:30.845174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a94ea-c50c-440a-acbd-4c25d9d8935a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:30.879881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6515987-24d7-4afe-a2f7-5035691018f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:30.880610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6515987-24d7-4afe-a2f7-5035691018f3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:30.880940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6515987-24d7-4afe-a2f7-5035691018f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:30.881214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6515987-24d7-4afe-a2f7-5035691018f3 None admin] PATH_INFO: `/v3/users/cb9ccdc75e3c46e698b03cb2cfdf1f88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:30.894559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6515987-24d7-4afe-a2f7-5035691018f3 None admin] RBAC: Authorizing `identity:get_user(user_id=cb9ccdc75e3c46e698b03cb2cfdf1f88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:30.896136 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6515987-24d7-4afe-a2f7-5035691018f3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:30.897978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 534/1056] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:20:30 2022] GET /identity/v3/users/cb9ccdc75e3c46e698b03cb2cfdf1f88 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:30.903669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fff70-afe5-4ffa-b162-70952fba3b77 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:31.006684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fff70-afe5-4ffa-b162-70952fba3b77 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:31.040623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7f2e9-3b82-4ec0-a0ea-f5c0d1e335b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:31.041232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7f2e9-3b82-4ec0-a0ea-f5c0d1e335b8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:31.041506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7f2e9-3b82-4ec0-a0ea-f5c0d1e335b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:31.041778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7f2e9-3b82-4ec0-a0ea-f5c0d1e335b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:31.083489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:31.110626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7f2e9-3b82-4ec0-a0ea-f5c0d1e335b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:31.112102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7f2e9-3b82-4ec0-a0ea-f5c0d1e335b8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:31.212128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 523/1057] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:20:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:20:31.218302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6515987-24d7-4afe-a2f7-5035691018f3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:31.327375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6515987-24d7-4afe-a2f7-5035691018f3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:31.337384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:31.362643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ef87d-f4a9-490f-b0bf-5e6b71384c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:31.363277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef87d-f4a9-490f-b0bf-5e6b71384c82 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:31.363578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef87d-f4a9-490f-b0bf-5e6b71384c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:31.363841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef87d-f4a9-490f-b0bf-5e6b71384c82 None admin] PATH_INFO: `/v3/projects/517f6254459d44d198fd5f688b9ddb04` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:31.364941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ef87d-f4a9-490f-b0bf-5e6b71384c82 None admin] RBAC: Authorizing `identity:get_project(project_id=517f6254459d44d198fd5f688b9ddb04)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:31.366739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ef87d-f4a9-490f-b0bf-5e6b71384c82 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:31.368625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 535/1058] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:20:31 2022] GET /identity/v3/projects/517f6254459d44d198fd5f688b9ddb04 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:31.378815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7f2e9-3b82-4ec0-a0ea-f5c0d1e335b8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:31.449845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:31.483977 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7f2e9-3b82-4ec0-a0ea-f5c0d1e335b8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:31.518848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e107e-f6d8-460d-9170-4c5cd9990b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:31.519489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e107e-f6d8-460d-9170-4c5cd9990b8a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:31.519760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e107e-f6d8-460d-9170-4c5cd9990b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:31.520031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e107e-f6d8-460d-9170-4c5cd9990b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:31.520745 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e107e-f6d8-460d-9170-4c5cd9990b8a None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=517f6254459d44d198fd5f688b9ddb04, user.id=cb9ccdc75e3c46e698b03cb2cfdf1f88) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:31.521049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e107e-f6d8-460d-9170-4c5cd9990b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:31.522540 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e107e-f6d8-460d-9170-4c5cd9990b8a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:31.528165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 524/1059] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:20:31 2022] GET /identity/v3/role_assignments?user.id=cb9ccdc75e3c46e698b03cb2cfdf1f88&scope.project.id=517f6254459d44d198fd5f688b9ddb04&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:31.867659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309275d-b163-4df2-b511-635f259bbb13 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:31.868213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309275d-b163-4df2-b511-635f259bbb13 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:31.868213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309275d-b163-4df2-b511-635f259bbb13 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:31.869692 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 536/1060] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:31.874957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6357a41-b6f8-46fd-8879-8195dceb00f9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:31.875405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6357a41-b6f8-46fd-8879-8195dceb00f9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:31.875483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6357a41-b6f8-46fd-8879-8195dceb00f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:31.894080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c6357a41-b6f8-46fd-8879-8195dceb00f9 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:31.895248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c6357a41-b6f8-46fd-8879-8195dceb00f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:31.964636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 525/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:32.101017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a73a-eec2-45bc-8640-bb6d1a267bd2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:32.101414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a73a-eec2-45bc-8640-bb6d1a267bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:32.101537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a73a-eec2-45bc-8640-bb6d1a267bd2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:32.103059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 537/1062] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:32.108346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e807-cb0c-4757-bd1f-0b51d2fd9da5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:32.108599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e807-cb0c-4757-bd1f-0b51d2fd9da5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:32.108899 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e807-cb0c-4757-bd1f-0b51d2fd9da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:32.128289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3f68e807-cb0c-4757-bd1f-0b51d2fd9da5 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:32.129389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3f68e807-cb0c-4757-bd1f-0b51d2fd9da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:32.190529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:32.199902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 526/1063] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:32.226196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2a73a-eec2-45bc-8640-bb6d1a267bd2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:32.339528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2a73a-eec2-45bc-8640-bb6d1a267bd2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:32.374438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd21f5f-96a5-4aa5-ba50-4cbb2610616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:32.375045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd21f5f-96a5-4aa5-ba50-4cbb2610616d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:32.375345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd21f5f-96a5-4aa5-ba50-4cbb2610616d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:32.375630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd21f5f-96a5-4aa5-ba50-4cbb2610616d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:32.423537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:32.447187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd21f5f-96a5-4aa5-ba50-4cbb2610616d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:32.448677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd21f5f-96a5-4aa5-ba50-4cbb2610616d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:32.478817 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e807-cb0c-4757-bd1f-0b51d2fd9da5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:32.564211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 538/1064] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:20:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:20:32.570254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd21f5f-96a5-4aa5-ba50-4cbb2610616d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:32.593942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e807-cb0c-4757-bd1f-0b51d2fd9da5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:32.638183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b75b1-0fb2-4f1c-b95d-a7dc6632cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:32.638956 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b75b1-0fb2-4f1c-b95d-a7dc6632cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:32.639232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b75b1-0fb2-4f1c-b95d-a7dc6632cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:32.639525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b75b1-0fb2-4f1c-b95d-a7dc6632cfc0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:32.647245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:32.653187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b75b1-0fb2-4f1c-b95d-a7dc6632cfc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-728b75b1-0fb2-4f1c-b95d-a7dc6632cfc0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:20:32.658536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:32.659545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:32.660415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 527/1065] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 6 04:20:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:32.666284 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b75b1-0fb2-4f1c-b95d-a7dc6632cfc0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:32.674390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd21f5f-96a5-4aa5-ba50-4cbb2610616d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:32.709494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4942a-39ce-4ef2-83d1-221f4313a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:32.710132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4942a-39ce-4ef2-83d1-221f4313a55b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:32.710406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4942a-39ce-4ef2-83d1-221f4313a55b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:32.710674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4942a-39ce-4ef2-83d1-221f4313a55b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:32.721591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4942a-39ce-4ef2-83d1-221f4313a55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:32.723033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4942a-39ce-4ef2-83d1-221f4313a55b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:32.727775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6cb4942a-39ce-4ef2-83d1-221f4313a55b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:32.738714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:32.739755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:32.741578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:32.741578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:32.741578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:32.741578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 539/1066] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:32.746135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4942a-39ce-4ef2-83d1-221f4313a55b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:32.778407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b75b1-0fb2-4f1c-b95d-a7dc6632cfc0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:32.814326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5781b5-692b-401b-a426-e2791767fbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:32.814933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5781b5-692b-401b-a426-e2791767fbfa None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:32.815207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5781b5-692b-401b-a426-e2791767fbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:32.815503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5781b5-692b-401b-a426-e2791767fbfa None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:32.816170 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5781b5-692b-401b-a426-e2791767fbfa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:32.816469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5781b5-692b-401b-a426-e2791767fbfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:32.817862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5781b5-692b-401b-a426-e2791767fbfa None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:32.830749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 528/1067] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 6 04:20:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:32.832653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5781b5-692b-401b-a426-e2791767fbfa None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:32.853419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4942a-39ce-4ef2-83d1-221f4313a55b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:32.882343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:32.892089 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04686ff-4656-4978-90b0-681b0670cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:32.892846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04686ff-4656-4978-90b0-681b0670cdbc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:32.893124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04686ff-4656-4978-90b0-681b0670cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:32.893391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04686ff-4656-4978-90b0-681b0670cdbc None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:32.894033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04686ff-4656-4978-90b0-681b0670cdbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:32.894329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04686ff-4656-4978-90b0-681b0670cdbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:32.895727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04686ff-4656-4978-90b0-681b0670cdbc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:32.919338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 540/1068] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:32.949729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5781b5-692b-401b-a426-e2791767fbfa None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:32.969412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:32.990182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a29f-62f2-46ef-bff9-870c58b68f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:32.990838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a29f-62f2-46ef-bff9-870c58b68f0a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:32.991509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a29f-62f2-46ef-bff9-870c58b68f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:32.991778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a29f-62f2-46ef-bff9-870c58b68f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:33.004107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3a29f-62f2-46ef-bff9-870c58b68f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:33.005597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3a29f-62f2-46ef-bff9-870c58b68f0a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-2fe3a29f-62f2-46ef-bff9-870c58b68f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:33.021359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:33.022418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:33.023346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:33.023346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:33.023346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:33.023346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 529/1069] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:33.028695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04686ff-4656-4978-90b0-681b0670cdbc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:33.139650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04686ff-4656-4978-90b0-681b0670cdbc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:33.174862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411000a4-9f6a-4e74-af22-cfd94c250c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:33.175521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411000a4-9f6a-4e74-af22-cfd94c250c96 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:33.175795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411000a4-9f6a-4e74-af22-cfd94c250c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:33.176060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411000a4-9f6a-4e74-af22-cfd94c250c96 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:33.176701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411000a4-9f6a-4e74-af22-cfd94c250c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:33.176999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411000a4-9f6a-4e74-af22-cfd94c250c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:33.178384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411000a4-9f6a-4e74-af22-cfd94c250c96 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:33.190563 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 541/1070] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:33.196265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a29f-62f2-46ef-bff9-870c58b68f0a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:33.298317 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a29f-62f2-46ef-bff9-870c58b68f0a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:33.337347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7253bf7-494b-4627-b539-b03c93b0230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:33.337974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7253bf7-494b-4627-b539-b03c93b0230c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:33.338248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7253bf7-494b-4627-b539-b03c93b0230c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:33.338507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7253bf7-494b-4627-b539-b03c93b0230c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:33.346304 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7253bf7-494b-4627-b539-b03c93b0230c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:33.347796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7253bf7-494b-4627-b539-b03c93b0230c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f7253bf7-494b-4627-b539-b03c93b0230c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:20:33.358898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:33.364877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:33.366438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 530/1071] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 6 04:20:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:33.368283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411000a4-9f6a-4e74-af22-cfd94c250c96 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:33.420023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:33.472200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411000a4-9f6a-4e74-af22-cfd94c250c96 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:33.506153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04a14-8c47-48a0-a626-2d0979447a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:33.506768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04a14-8c47-48a0-a626-2d0979447a61 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:33.507043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04a14-8c47-48a0-a626-2d0979447a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:33.507334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04a14-8c47-48a0-a626-2d0979447a61 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:33.508059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04a14-8c47-48a0-a626-2d0979447a61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:33.508361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04a14-8c47-48a0-a626-2d0979447a61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:33.509789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04a14-8c47-48a0-a626-2d0979447a61 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:33.526738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 542/1072] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 6 04:20:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:33.533004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7253bf7-494b-4627-b539-b03c93b0230c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:33.567201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:33.639394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7253bf7-494b-4627-b539-b03c93b0230c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:33.671845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114f9fb-7681-48dd-9a72-abdeea9d917a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:33.672128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114f9fb-7681-48dd-9a72-abdeea9d917a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:33.672444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114f9fb-7681-48dd-9a72-abdeea9d917a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:33.673797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 543/1073] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:33.674309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96d264-aba5-4a75-98bc-f34a4880fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:33.674942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96d264-aba5-4a75-98bc-f34a4880fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:33.675213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96d264-aba5-4a75-98bc-f34a4880fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:33.675508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96d264-aba5-4a75-98bc-f34a4880fcf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:33.678881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d5d03-a57a-4428-9da6-526ac8065f27 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:33.679158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d5d03-a57a-4428-9da6-526ac8065f27 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:33.679452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d5d03-a57a-4428-9da6-526ac8065f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:33.687380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96d264-aba5-4a75-98bc-f34a4880fcf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:33.688846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96d264-aba5-4a75-98bc-f34a4880fcf8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:33.697684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ea0d5d03-a57a-4428-9da6-526ac8065f27 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:33.698860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ea0d5d03-a57a-4428-9da6-526ac8065f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-9e96d264-aba5-4a75-98bc-f34a4880fcf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:33.703208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:33.704467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:33.705457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:33.705457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:33.705457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:33.705457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 531/1074] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:33.710019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96d264-aba5-4a75-98bc-f34a4880fcf8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:33.767469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 544/1075] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:33.789611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:33.808925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96d264-aba5-4a75-98bc-f34a4880fcf8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:33.843810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40176654-a1e4-41cf-a25f-01c3cd3cdef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:33.844330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40176654-a1e4-41cf-a25f-01c3cd3cdef5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:33.844597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40176654-a1e4-41cf-a25f-01c3cd3cdef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:33.844858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40176654-a1e4-41cf-a25f-01c3cd3cdef5 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:33.845482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40176654-a1e4-41cf-a25f-01c3cd3cdef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:33.845776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40176654-a1e4-41cf-a25f-01c3cd3cdef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:33.847162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40176654-a1e4-41cf-a25f-01c3cd3cdef5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:33.859066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 532/1076] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:33.864868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d5d03-a57a-4428-9da6-526ac8065f27 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:33.899923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:33.965521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d5d03-a57a-4428-9da6-526ac8065f27 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:33.999047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5a0f9-6aba-4052-a5af-76c89f2d7637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:33.999702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5a0f9-6aba-4052-a5af-76c89f2d7637 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:33.999977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5a0f9-6aba-4052-a5af-76c89f2d7637 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:34.000240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5a0f9-6aba-4052-a5af-76c89f2d7637 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:34.006646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5a0f9-6aba-4052-a5af-76c89f2d7637 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:34.008101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5a0f9-6aba-4052-a5af-76c89f2d7637 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-cfd5a0f9-6aba-4052-a5af-76c89f2d7637 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:20:34.019568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:34.020632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:34.021543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:20:34.021543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:20:34.021543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:20:34.021543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:20:34.021543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:20:34.021543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:20:34.021543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:34.021543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:34.021543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 545/1077] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:34.026771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40176654-a1e4-41cf-a25f-01c3cd3cdef5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:34.042226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5a0f9-6aba-4052-a5af-76c89f2d7637 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:34.130670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40176654-a1e4-41cf-a25f-01c3cd3cdef5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:34.138273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:34.144544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5a0f9-6aba-4052-a5af-76c89f2d7637 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:34.168235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211173-6828-4b7f-b056-25847ae03ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:34.168883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211173-6828-4b7f-b056-25847ae03ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:34.169179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211173-6828-4b7f-b056-25847ae03ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:34.169443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211173-6828-4b7f-b056-25847ae03ff2 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:34.170522 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211173-6828-4b7f-b056-25847ae03ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:34.170832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211173-6828-4b7f-b056-25847ae03ff2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:34.172341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211173-6828-4b7f-b056-25847ae03ff2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:34.178434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0c2e9-24af-4631-add3-e65797f01498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:34.179072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0c2e9-24af-4631-add3-e65797f01498 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:34.179371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0c2e9-24af-4631-add3-e65797f01498 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:34.179642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0c2e9-24af-4631-add3-e65797f01498 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:34.184146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 533/1078] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:34.189770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0c2e9-24af-4631-add3-e65797f01498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:20:34.190914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211173-6828-4b7f-b056-25847ae03ff2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:34.193543 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-48f0c2e9-24af-4631-add3-e65797f01498 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:20:34.195251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:34.199664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:34.200686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 546/1079] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:20:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:34.202736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0c2e9-24af-4631-add3-e65797f01498 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:34.291783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211173-6828-4b7f-b056-25847ae03ff2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:34.300905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0c2e9-24af-4631-add3-e65797f01498 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:34.327551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0562a-813b-42f1-b1a2-376e125e3287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:34.328230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0562a-813b-42f1-b1a2-376e125e3287 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:34.328504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0562a-813b-42f1-b1a2-376e125e3287 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:34.328777 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0562a-813b-42f1-b1a2-376e125e3287 None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/0481d4c0be0b46189e339d1e00bee4c0/roles/cc4b0fb15df246e28abd425b2bb85d33` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:34.331449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0562a-813b-42f1-b1a2-376e125e3287 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=0481d4c0be0b46189e339d1e00bee4c0, role_id=cc4b0fb15df246e28abd425b2bb85d33)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:34.332927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0562a-813b-42f1-b1a2-376e125e3287 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:34.335753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ccfd-2a96-4a04-8f9e-b6f0dfe84a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:34.336358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ccfd-2a96-4a04-8f9e-b6f0dfe84a89 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:34.336624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ccfd-2a96-4a04-8f9e-b6f0dfe84a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:34.336867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ccfd-2a96-4a04-8f9e-b6f0dfe84a89 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:34.337581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ccfd-2a96-4a04-8f9e-b6f0dfe84a89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:34.337826 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ccfd-2a96-4a04-8f9e-b6f0dfe84a89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:34.339448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ccfd-2a96-4a04-8f9e-b6f0dfe84a89 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:34.346694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 534/1080] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:20:34 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/0481d4c0be0b46189e339d1e00bee4c0/roles/cc4b0fb15df246e28abd425b2bb85d33 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:20:34.354904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 547/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:34.361582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0562a-813b-42f1-b1a2-376e125e3287 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:34.429906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:34.473740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0562a-813b-42f1-b1a2-376e125e3287 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:34.512687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce314b90-d3bd-4774-b422-57eb2046be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:34.513308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314b90-d3bd-4774-b422-57eb2046be0e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:34.513704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314b90-d3bd-4774-b422-57eb2046be0e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:34.514092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314b90-d3bd-4774-b422-57eb2046be0e None admin] PATH_INFO: `/v3/users/cb9ccdc75e3c46e698b03cb2cfdf1f88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:34.515442 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce314b90-d3bd-4774-b422-57eb2046be0e None admin] RBAC: Authorizing `identity:get_user(user_id=cb9ccdc75e3c46e698b03cb2cfdf1f88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:34.516878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce314b90-d3bd-4774-b422-57eb2046be0e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:34.519485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 535/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:20:34 2022] GET /identity/v3/users/cb9ccdc75e3c46e698b03cb2cfdf1f88 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:34.524754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ccfd-2a96-4a04-8f9e-b6f0dfe84a89 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:34.547135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:34.631341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ccfd-2a96-4a04-8f9e-b6f0dfe84a89 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:34.666631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aecb8-52a1-4686-b22d-79f8ee720c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:34.667255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aecb8-52a1-4686-b22d-79f8ee720c28 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:34.667553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aecb8-52a1-4686-b22d-79f8ee720c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:34.667827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aecb8-52a1-4686-b22d-79f8ee720c28 None admin] PATH_INFO: `/v3/projects/517f6254459d44d198fd5f688b9ddb04` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:34.668971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aecb8-52a1-4686-b22d-79f8ee720c28 None admin] RBAC: Authorizing `identity:get_project(project_id=517f6254459d44d198fd5f688b9ddb04)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:34.670508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aecb8-52a1-4686-b22d-79f8ee720c28 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:34.672181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 548/1083] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:20:34 2022] GET /identity/v3/projects/517f6254459d44d198fd5f688b9ddb04 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:34.678233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce314b90-d3bd-4774-b422-57eb2046be0e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:34.780052 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce314b90-d3bd-4774-b422-57eb2046be0e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:34.809417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:34.816393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d860e9-50b0-4825-b8b4-90f78b211a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:34.817099 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d860e9-50b0-4825-b8b4-90f78b211a00 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:34.817352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d860e9-50b0-4825-b8b4-90f78b211a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:34.817612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d860e9-50b0-4825-b8b4-90f78b211a00 None admin] PATH_INFO: `/v3/projects/517f6254459d44d198fd5f688b9ddb04/users/cb9ccdc75e3c46e698b03cb2cfdf1f88/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:34.819568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d860e9-50b0-4825-b8b4-90f78b211a00 None admin] RBAC: Authorizing `identity:create_grant(project_id=517f6254459d44d198fd5f688b9ddb04, user_id=cb9ccdc75e3c46e698b03cb2cfdf1f88, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:34.821010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d860e9-50b0-4825-b8b4-90f78b211a00 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:34.834775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 536/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:20:34 2022] PUT /identity/v3/projects/517f6254459d44d198fd5f688b9ddb04/users/cb9ccdc75e3c46e698b03cb2cfdf1f88/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:20:36.557797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98433-ad72-4fa1-a74e-9c8c0ca39c6e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:36.558366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98433-ad72-4fa1-a74e-9c8c0ca39c6e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:36.558366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98433-ad72-4fa1-a74e-9c8c0ca39c6e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:36.559699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 549/1085] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:36.565214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0287-2e2c-4e3f-be60-4dc682935a1e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:36.565657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0287-2e2c-4e3f-be60-4dc682935a1e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:36.565759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0287-2e2c-4e3f-be60-4dc682935a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:36.584210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e13b0287-2e2c-4e3f-be60-4dc682935a1e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:36.585312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e13b0287-2e2c-4e3f-be60-4dc682935a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:36.652518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 537/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:36.921581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f98433-ad72-4fa1-a74e-9c8c0ca39c6e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.010614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:37.015045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de39fb-1b76-4682-aedd-4a4a89cc136c None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.015380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de39fb-1b76-4682-aedd-4a4a89cc136c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.015651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de39fb-1b76-4682-aedd-4a4a89cc136c None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.017006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 538/1087] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:37.021959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3aeaf-2cac-4f7d-b1c9-2660c5fc010e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.022241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3aeaf-2cac-4f7d-b1c9-2660c5fc010e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.022513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3aeaf-2cac-4f7d-b1c9-2660c5fc010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.027433 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f98433-ad72-4fa1-a74e-9c8c0ca39c6e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:37.045189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e3c3aeaf-2cac-4f7d-b1c9-2660c5fc010e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:37.046378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e3c3aeaf-2cac-4f7d-b1c9-2660c5fc010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:37.067101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c55730-6608-4039-91e0-9c92f5ee4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:37.067754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c55730-6608-4039-91e0-9c92f5ee4bcf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.068025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c55730-6608-4039-91e0-9c92f5ee4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.068289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c55730-6608-4039-91e0-9c92f5ee4bcf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.078211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c55730-6608-4039-91e0-9c92f5ee4bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d8c55730-6608-4039-91e0-9c92f5ee4bcf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:20:37.082964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:37.084159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:37.085011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 550/1088] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Oct 6 04:20:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:37.090271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c55730-6608-4039-91e0-9c92f5ee4bcf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.114033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 539/1089] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:37.191536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c55730-6608-4039-91e0-9c92f5ee4bcf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:37.224291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e77d20-0c3a-4361-ad37-f22c53911b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:37.224894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e77d20-0c3a-4361-ad37-f22c53911b4d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.225166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e77d20-0c3a-4361-ad37-f22c53911b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.225431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e77d20-0c3a-4361-ad37-f22c53911b4d None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.226091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e77d20-0c3a-4361-ad37-f22c53911b4d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:37.226390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e77d20-0c3a-4361-ad37-f22c53911b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:37.227787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e77d20-0c3a-4361-ad37-f22c53911b4d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:37.235559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 551/1090] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 6 04:20:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:37.242425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3aeaf-2cac-4f7d-b1c9-2660c5fc010e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.295500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:37.346593 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3aeaf-2cac-4f7d-b1c9-2660c5fc010e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:37.380608 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1bc89-98d4-4f34-b36d-7de20487f59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:37.381122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e77d20-0c3a-4361-ad37-f22c53911b4d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.381275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1bc89-98d4-4f34-b36d-7de20487f59a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.381497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1bc89-98d4-4f34-b36d-7de20487f59a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.381747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1bc89-98d4-4f34-b36d-7de20487f59a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.392222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1bc89-98d4-4f34-b36d-7de20487f59a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:37.393107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:37.393679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1bc89-98d4-4f34-b36d-7de20487f59a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-44a1bc89-98d4-4f34-b36d-7de20487f59a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:37.409916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:37.411032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:37.411994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:37.411994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:37.411994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:37.411994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 540/1091] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:37.416877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1bc89-98d4-4f34-b36d-7de20487f59a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.488040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e77d20-0c3a-4361-ad37-f22c53911b4d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:37.512803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1bc89-98d4-4f34-b36d-7de20487f59a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:37.514357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:37.521300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd0f98-8aa8-4ecd-ad7b-0857490df8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:37.521924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0f98-8aa8-4ecd-ad7b-0857490df8de None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.522194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0f98-8aa8-4ecd-ad7b-0857490df8de None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.522462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0f98-8aa8-4ecd-ad7b-0857490df8de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.532774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd0f98-8aa8-4ecd-ad7b-0857490df8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-98cd0f98-8aa8-4ecd-ad7b-0857490df8de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:20:37.537544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:37.538656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:37.540018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 552/1092] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:20:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:37.544791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd0f98-8aa8-4ecd-ad7b-0857490df8de None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.551479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b44ca-e62f-48db-9adb-80ab800839b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:37.552090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b44ca-e62f-48db-9adb-80ab800839b0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.552360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b44ca-e62f-48db-9adb-80ab800839b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.552624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b44ca-e62f-48db-9adb-80ab800839b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.553264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b44ca-e62f-48db-9adb-80ab800839b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:37.553563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b44ca-e62f-48db-9adb-80ab800839b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:37.554960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b44ca-e62f-48db-9adb-80ab800839b0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:37.567339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 541/1093] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:37.572934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b44ca-e62f-48db-9adb-80ab800839b0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.610821 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:37.646809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd0f98-8aa8-4ecd-ad7b-0857490df8de None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:37.669779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b44ca-e62f-48db-9adb-80ab800839b0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:37.681602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19eee7-4d85-4e82-a51e-66e37b58157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:37.682204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19eee7-4d85-4e82-a51e-66e37b58157b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.682476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19eee7-4d85-4e82-a51e-66e37b58157b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.682738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19eee7-4d85-4e82-a51e-66e37b58157b None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.683431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19eee7-4d85-4e82-a51e-66e37b58157b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:37.683709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19eee7-4d85-4e82-a51e-66e37b58157b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:37.685121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19eee7-4d85-4e82-a51e-66e37b58157b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:37.693549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 553/1094] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:20:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:37.699647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19eee7-4d85-4e82-a51e-66e37b58157b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.705951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f57ed-84c0-4c28-ac68-048594d89224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:37.706585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f57ed-84c0-4c28-ac68-048594d89224 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.706858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f57ed-84c0-4c28-ac68-048594d89224 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.707125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f57ed-84c0-4c28-ac68-048594d89224 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.714563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f57ed-84c0-4c28-ac68-048594d89224 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:37.716076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f57ed-84c0-4c28-ac68-048594d89224 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-249f57ed-84c0-4c28-ac68-048594d89224 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:20:37.728018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:37.729119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:37.730090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 542/1095] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Oct 6 04:20:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:37.734911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f57ed-84c0-4c28-ac68-048594d89224 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.759964 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:37.800127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19eee7-4d85-4e82-a51e-66e37b58157b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:37.828085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:37.834185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f57ed-84c0-4c28-ac68-048594d89224 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:37.834774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e8e00-6bba-4715-9ebb-8e72b1c1de0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:37.835434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e8e00-6bba-4715-9ebb-8e72b1c1de0d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.835707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e8e00-6bba-4715-9ebb-8e72b1c1de0d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.835970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e8e00-6bba-4715-9ebb-8e72b1c1de0d None admin] PATH_INFO: `/v3/users/cb9ccdc75e3c46e698b03cb2cfdf1f88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.837115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e8e00-6bba-4715-9ebb-8e72b1c1de0d None admin] RBAC: Authorizing `identity:get_user(user_id=cb9ccdc75e3c46e698b03cb2cfdf1f88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:37.838513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e8e00-6bba-4715-9ebb-8e72b1c1de0d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:37.840125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 554/1096] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:20:37 2022] GET /identity/v3/users/cb9ccdc75e3c46e698b03cb2cfdf1f88 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:37.845827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e8e00-6bba-4715-9ebb-8e72b1c1de0d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.869311 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c34ba9-88c3-4d7c-84ae-1d6d787bab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:37.869911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c34ba9-88c3-4d7c-84ae-1d6d787bab8f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.870184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c34ba9-88c3-4d7c-84ae-1d6d787bab8f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.870448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c34ba9-88c3-4d7c-84ae-1d6d787bab8f None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.871170 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c34ba9-88c3-4d7c-84ae-1d6d787bab8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:37.871511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c34ba9-88c3-4d7c-84ae-1d6d787bab8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:37.873499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c34ba9-88c3-4d7c-84ae-1d6d787bab8f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:37.890840 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 543/1097] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Oct 6 04:20:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:37.896703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c34ba9-88c3-4d7c-84ae-1d6d787bab8f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:37.944194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e8e00-6bba-4715-9ebb-8e72b1c1de0d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:37.976774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:37.980616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65b0a-3da3-4870-98f1-3931bbf2cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:37.981224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65b0a-3da3-4870-98f1-3931bbf2cba7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:37.981495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65b0a-3da3-4870-98f1-3931bbf2cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:37.981772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65b0a-3da3-4870-98f1-3931bbf2cba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:37.996629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c34ba9-88c3-4d7c-84ae-1d6d787bab8f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:38.031071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeedd27-7142-45d8-9497-1f874e0e1483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:38.031629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeedd27-7142-45d8-9497-1f874e0e1483 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:38.031903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeedd27-7142-45d8-9497-1f874e0e1483 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:38.032146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeedd27-7142-45d8-9497-1f874e0e1483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:38.045637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:38.050284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d65b0a-3da3-4870-98f1-3931bbf2cba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:38.051778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d65b0a-3da3-4870-98f1-3931bbf2cba7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:38.097331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeedd27-7142-45d8-9497-1f874e0e1483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:38.098757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeedd27-7142-45d8-9497-1f874e0e1483 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:38.150781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 555/1098] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:20:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 04:20:38.157302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65b0a-3da3-4870-98f1-3931bbf2cba7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:38.182035 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:38.202455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 544/1099] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:20:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:20:38.208306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeedd27-7142-45d8-9497-1f874e0e1483 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:38.254679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:38.258908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65b0a-3da3-4870-98f1-3931bbf2cba7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:38.295284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914a2c8-a52d-4aa1-92e5-602c19a92f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:38.295887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914a2c8-a52d-4aa1-92e5-602c19a92f29 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:38.296164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914a2c8-a52d-4aa1-92e5-602c19a92f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:38.296439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914a2c8-a52d-4aa1-92e5-602c19a92f29 None admin] PATH_INFO: `/v3/projects/517f6254459d44d198fd5f688b9ddb04` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:38.297557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914a2c8-a52d-4aa1-92e5-602c19a92f29 None admin] RBAC: Authorizing `identity:get_project(project_id=517f6254459d44d198fd5f688b9ddb04)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:38.298989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914a2c8-a52d-4aa1-92e5-602c19a92f29 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:38.300670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 556/1100] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:20:38 2022] GET /identity/v3/projects/517f6254459d44d198fd5f688b9ddb04 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:38.307411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914a2c8-a52d-4aa1-92e5-602c19a92f29 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:38.315993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeedd27-7142-45d8-9497-1f874e0e1483 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:38.350174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42499f-adff-4358-8929-9d993637ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:38.350809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42499f-adff-4358-8929-9d993637ec45 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:38.351072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42499f-adff-4358-8929-9d993637ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:38.351372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42499f-adff-4358-8929-9d993637ec45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:38.361290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42499f-adff-4358-8929-9d993637ec45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:38.362746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42499f-adff-4358-8929-9d993637ec45 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-7f42499f-adff-4358-8929-9d993637ec45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:20:38.377292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:38.378389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:20:38.379460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:20:38.379460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:20:38.379460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:38.379460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 545/1101] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:20:38.384143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42499f-adff-4358-8929-9d993637ec45 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:38.410626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914a2c8-a52d-4aa1-92e5-602c19a92f29 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:38.414536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:38.448373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91167d5c-b522-4da7-9456-c1f170635052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:38.448976 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167d5c-b522-4da7-9456-c1f170635052 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:38.449246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167d5c-b522-4da7-9456-c1f170635052 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:38.449542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167d5c-b522-4da7-9456-c1f170635052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:38.450257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91167d5c-b522-4da7-9456-c1f170635052 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=517f6254459d44d198fd5f688b9ddb04, user.id=cb9ccdc75e3c46e698b03cb2cfdf1f88) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:38.450555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91167d5c-b522-4da7-9456-c1f170635052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:38.452053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91167d5c-b522-4da7-9456-c1f170635052 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:38.458634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 557/1102] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:20:38 2022] GET /identity/v3/role_assignments?user.id=cb9ccdc75e3c46e698b03cb2cfdf1f88&scope.project.id=517f6254459d44d198fd5f688b9ddb04&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:38.486916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42499f-adff-4358-8929-9d993637ec45 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:38.525032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c176e-bd7c-47a2-98ae-b646ebb85d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:38.525660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c176e-bd7c-47a2-98ae-b646ebb85d4e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:38.525936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c176e-bd7c-47a2-98ae-b646ebb85d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:38.526202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c176e-bd7c-47a2-98ae-b646ebb85d4e None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:38.526858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c176e-bd7c-47a2-98ae-b646ebb85d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:38.527155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c176e-bd7c-47a2-98ae-b646ebb85d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:38.528625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c176e-bd7c-47a2-98ae-b646ebb85d4e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:38.542154 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 546/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:20:38.549526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91167d5c-b522-4da7-9456-c1f170635052 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:38.584403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:38.662720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91167d5c-b522-4da7-9456-c1f170635052 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:38.697605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd467c05-5028-47f4-ab4c-7bf3c5198da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:38.698238 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467c05-5028-47f4-ab4c-7bf3c5198da8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:38.698516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467c05-5028-47f4-ab4c-7bf3c5198da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:38.698780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467c05-5028-47f4-ab4c-7bf3c5198da8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:38.705702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd467c05-5028-47f4-ab4c-7bf3c5198da8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:38.707127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd467c05-5028-47f4-ab4c-7bf3c5198da8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-dd467c05-5028-47f4-ab4c-7bf3c5198da8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:20:38.718537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:38.719610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:38.721043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:20:38.721043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:20:38.721043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:20:38.721043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:20:38.721043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:20:38.721043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:20:38.721043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:20:38.721043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:20:38.721043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 558/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:38.725638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c176e-bd7c-47a2-98ae-b646ebb85d4e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:38.821964 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:38.832222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c176e-bd7c-47a2-98ae-b646ebb85d4e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:38.869137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae223a-11dd-4b0c-a8d8-789fec216006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:38.869742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae223a-11dd-4b0c-a8d8-789fec216006 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:38.870016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae223a-11dd-4b0c-a8d8-789fec216006 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:38.870265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae223a-11dd-4b0c-a8d8-789fec216006 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:38.870957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae223a-11dd-4b0c-a8d8-789fec216006 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:38.871262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae223a-11dd-4b0c-a8d8-789fec216006 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:38.873286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae223a-11dd-4b0c-a8d8-789fec216006 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:38.885237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 547/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:38.891612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd467c05-5028-47f4-ab4c-7bf3c5198da8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:38.986660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:38.997186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd467c05-5028-47f4-ab4c-7bf3c5198da8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:39.032146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318c1ef-d3bc-4297-981a-9feebb2d46fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:39.032754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318c1ef-d3bc-4297-981a-9feebb2d46fa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:39.033003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318c1ef-d3bc-4297-981a-9feebb2d46fa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:39.033300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318c1ef-d3bc-4297-981a-9feebb2d46fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:39.034022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318c1ef-d3bc-4297-981a-9feebb2d46fa None admin] RBAC: Adding query filter params (role.id=cc4b0fb15df246e28abd425b2bb85d33, scope.project.id=e6bea894013f40638404395075ade90d, user.id=0481d4c0be0b46189e339d1e00bee4c0) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:39.034686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318c1ef-d3bc-4297-981a-9feebb2d46fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:39.036127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318c1ef-d3bc-4297-981a-9feebb2d46fa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:39.042048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 559/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:20:38 2022] GET /identity/v3/role_assignments?user.id=0481d4c0be0b46189e339d1e00bee4c0&scope.project.id=e6bea894013f40638404395075ade90d&role.id=cc4b0fb15df246e28abd425b2bb85d33 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:40.623971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267136a-405a-45fb-b5f2-03add190a254 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:40.624505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267136a-405a-45fb-b5f2-03add190a254 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:40.624505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267136a-405a-45fb-b5f2-03add190a254 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:40.625742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 548/1107] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:40.632133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d60890-1d71-4791-8e4d-06e37b572fd3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:40.632856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d60890-1d71-4791-8e4d-06e37b572fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:40.633001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d60890-1d71-4791-8e4d-06e37b572fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:40.655690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-74d60890-1d71-4791-8e4d-06e37b572fd3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:40.656875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-74d60890-1d71-4791-8e4d-06e37b572fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:40.734633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 560/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:41.000200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267136a-405a-45fb-b5f2-03add190a254 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:41.106251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267136a-405a-45fb-b5f2-03add190a254 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:41.144736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c813fb5-d1e8-4ea9-a988-1a07b4701950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:41.145351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c813fb5-d1e8-4ea9-a988-1a07b4701950 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:41.145618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c813fb5-d1e8-4ea9-a988-1a07b4701950 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:41.145880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c813fb5-d1e8-4ea9-a988-1a07b4701950 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:41.147098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c813fb5-d1e8-4ea9-a988-1a07b4701950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:41.148563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c813fb5-d1e8-4ea9-a988-1a07b4701950 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:41.150137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 549/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:41.156213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d60890-1d71-4791-8e4d-06e37b572fd3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:41.248486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:41.267998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d60890-1d71-4791-8e4d-06e37b572fd3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:41.302505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd061122-7a32-49cb-b844-6a44b353b2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:41.303102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061122-7a32-49cb-b844-6a44b353b2b1 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:41.303739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061122-7a32-49cb-b844-6a44b353b2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:41.303739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061122-7a32-49cb-b844-6a44b353b2b1 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:41.304291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd061122-7a32-49cb-b844-6a44b353b2b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:41.305711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd061122-7a32-49cb-b844-6a44b353b2b1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:41.331284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 561/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:20:41 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:20:43.504313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0c123-0d7a-4289-9247-6370ecde797c None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:43.505231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0c123-0d7a-4289-9247-6370ecde797c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:43.505231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0c123-0d7a-4289-9247-6370ecde797c None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:43.507339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 550/1111] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:43.515784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af747538-55f3-4e3c-a595-0e6310a9a259 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:43.516197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af747538-55f3-4e3c-a595-0e6310a9a259 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:43.516326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af747538-55f3-4e3c-a595-0e6310a9a259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:43.536213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-af747538-55f3-4e3c-a595-0e6310a9a259 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:43.537416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-af747538-55f3-4e3c-a595-0e6310a9a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:43.612892 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 562/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:43.894836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0c123-0d7a-4289-9247-6370ecde797c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:43.920634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:44.009744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0c123-0d7a-4289-9247-6370ecde797c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:44.045993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0cd6e-8f68-40ec-91bf-277354b74cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:44.046617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0cd6e-8f68-40ec-91bf-277354b74cbe None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:44.046892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0cd6e-8f68-40ec-91bf-277354b74cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:44.047162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0cd6e-8f68-40ec-91bf-277354b74cbe None admin] PATH_INFO: `/v3/roles/35a096ec554741cb99e599760e23fe4d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:44.048704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0cd6e-8f68-40ec-91bf-277354b74cbe None admin] RBAC: Authorizing `identity:get_role(role_id=35a096ec554741cb99e599760e23fe4d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:44.050085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0cd6e-8f68-40ec-91bf-277354b74cbe None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:44.051436 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 551/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:20:43 2022] GET /identity/v3/roles/35a096ec554741cb99e599760e23fe4d => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:44.058131 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af747538-55f3-4e3c-a595-0e6310a9a259 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:44.145462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:44.182129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af747538-55f3-4e3c-a595-0e6310a9a259 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:44.218573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133a0f2-95b1-4c40-b4d8-35668aacc852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:44.219193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133a0f2-95b1-4c40-b4d8-35668aacc852 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:44.219496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133a0f2-95b1-4c40-b4d8-35668aacc852 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:44.219763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133a0f2-95b1-4c40-b4d8-35668aacc852 None admin] PATH_INFO: `/v3/users/a9835e6cd27e4842a65436a567a1a881` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:44.234426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133a0f2-95b1-4c40-b4d8-35668aacc852 None admin] RBAC: Authorizing `identity:get_user(user_id=a9835e6cd27e4842a65436a567a1a881)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:44.235911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133a0f2-95b1-4c40-b4d8-35668aacc852 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:44.237504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 563/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:20:44 2022] GET /identity/v3/users/a9835e6cd27e4842a65436a567a1a881 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:44.243995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0cd6e-8f68-40ec-91bf-277354b74cbe None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:44.339780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:44.353064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0cd6e-8f68-40ec-91bf-277354b74cbe None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:44.388448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d6e96-6b18-4e73-8064-c74943ec601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:44.389062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d6e96-6b18-4e73-8064-c74943ec601b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:44.389335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d6e96-6b18-4e73-8064-c74943ec601b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:44.389603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d6e96-6b18-4e73-8064-c74943ec601b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:44.461930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d6e96-6b18-4e73-8064-c74943ec601b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:44.464428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d6e96-6b18-4e73-8064-c74943ec601b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:44.556594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:44.576704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 552/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:20:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:20:44.582895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133a0f2-95b1-4c40-b4d8-35668aacc852 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:44.685835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133a0f2-95b1-4c40-b4d8-35668aacc852 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:44.712211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:44.721630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a002a0-d6a9-4841-9425-8a80c0326737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:44.722265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a002a0-d6a9-4841-9425-8a80c0326737 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:44.722536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a002a0-d6a9-4841-9425-8a80c0326737 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:44.722803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a002a0-d6a9-4841-9425-8a80c0326737 None admin] PATH_INFO: `/v3/projects/517f6254459d44d198fd5f688b9ddb04` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:44.723988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a002a0-d6a9-4841-9425-8a80c0326737 None admin] RBAC: Authorizing `identity:get_project(project_id=517f6254459d44d198fd5f688b9ddb04)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:44.725421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a002a0-d6a9-4841-9425-8a80c0326737 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:44.727048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 564/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:20:44 2022] GET /identity/v3/projects/517f6254459d44d198fd5f688b9ddb04 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:44.733642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d6e96-6b18-4e73-8064-c74943ec601b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:44.834942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d6e96-6b18-4e73-8064-c74943ec601b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:44.870518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2945d3-bb10-47b4-a565-c43b30d1a950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:44.871108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2945d3-bb10-47b4-a565-c43b30d1a950 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:44.871377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2945d3-bb10-47b4-a565-c43b30d1a950 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:44.871890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2945d3-bb10-47b4-a565-c43b30d1a950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:44.872715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2945d3-bb10-47b4-a565-c43b30d1a950 None admin] RBAC: Adding query filter params (role.id=35a096ec554741cb99e599760e23fe4d, scope.project.id=517f6254459d44d198fd5f688b9ddb04, user.id=a9835e6cd27e4842a65436a567a1a881) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:44.873017 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2945d3-bb10-47b4-a565-c43b30d1a950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:44.874430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2945d3-bb10-47b4-a565-c43b30d1a950 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:44.879897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 553/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:20:44 2022] GET /identity/v3/role_assignments?user.id=a9835e6cd27e4842a65436a567a1a881&scope.project.id=517f6254459d44d198fd5f688b9ddb04&role.id=35a096ec554741cb99e599760e23fe4d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:46.964060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5f25-b592-4cec-b36c-88dee8ae7b2d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:46.964962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5f25-b592-4cec-b36c-88dee8ae7b2d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:46.964962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5f25-b592-4cec-b36c-88dee8ae7b2d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:46.967058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 565/1118] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:46.972672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765368c2-a438-4154-84b0-b9a3a253a126 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:46.973091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765368c2-a438-4154-84b0-b9a3a253a126 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:46.973207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765368c2-a438-4154-84b0-b9a3a253a126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:46.992704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-765368c2-a438-4154-84b0-b9a3a253a126 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:46.993880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-765368c2-a438-4154-84b0-b9a3a253a126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:47.042859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:47.063721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 554/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:47.329332 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5f25-b592-4cec-b36c-88dee8ae7b2d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:47.434397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5f25-b592-4cec-b36c-88dee8ae7b2d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:47.469381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a0b30-bd3c-4c65-8d8c-a6ef3e920d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:47.470003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a0b30-bd3c-4c65-8d8c-a6ef3e920d73 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:47.470280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a0b30-bd3c-4c65-8d8c-a6ef3e920d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:47.470540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a0b30-bd3c-4c65-8d8c-a6ef3e920d73 None admin] PATH_INFO: `/v3/roles/35a096ec554741cb99e599760e23fe4d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:47.472108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a0b30-bd3c-4c65-8d8c-a6ef3e920d73 None admin] RBAC: Authorizing `identity:get_role(role_id=35a096ec554741cb99e599760e23fe4d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:47.473477 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a0b30-bd3c-4c65-8d8c-a6ef3e920d73 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:47.474785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 566/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:20:47 2022] GET /identity/v3/roles/35a096ec554741cb99e599760e23fe4d => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:47.480902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765368c2-a438-4154-84b0-b9a3a253a126 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:47.585264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765368c2-a438-4154-84b0-b9a3a253a126 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:47.620759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92b94-fae3-4da8-b897-a170f02bf26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:47.621384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92b94-fae3-4da8-b897-a170f02bf26f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:47.621657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92b94-fae3-4da8-b897-a170f02bf26f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:47.621927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92b94-fae3-4da8-b897-a170f02bf26f None admin] PATH_INFO: `/v3/users/a9835e6cd27e4842a65436a567a1a881` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:47.623120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d92b94-fae3-4da8-b897-a170f02bf26f None admin] RBAC: Authorizing `identity:get_user(user_id=a9835e6cd27e4842a65436a567a1a881)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:47.624594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d92b94-fae3-4da8-b897-a170f02bf26f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:47.626162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 555/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:20:47 2022] GET /identity/v3/users/a9835e6cd27e4842a65436a567a1a881 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:47.632249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a0b30-bd3c-4c65-8d8c-a6ef3e920d73 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:47.700031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:47.739115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a0b30-bd3c-4c65-8d8c-a6ef3e920d73 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:47.775522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6158-6755-48ee-982e-b566d7d9d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:47.776137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6158-6755-48ee-982e-b566d7d9d035 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:47.776407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6158-6755-48ee-982e-b566d7d9d035 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:47.776670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6158-6755-48ee-982e-b566d7d9d035 None admin] PATH_INFO: `/v3/projects/517f6254459d44d198fd5f688b9ddb04` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:47.777900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c6158-6755-48ee-982e-b566d7d9d035 None admin] RBAC: Authorizing `identity:get_project(project_id=517f6254459d44d198fd5f688b9ddb04)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:47.779424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c6158-6755-48ee-982e-b566d7d9d035 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:47.781030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 567/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:20:47 2022] GET /identity/v3/projects/517f6254459d44d198fd5f688b9ddb04 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:47.790797 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92b94-fae3-4da8-b897-a170f02bf26f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:47.847746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:47.900022 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92b94-fae3-4da8-b897-a170f02bf26f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:47.934860 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ffa8f-1e26-4be8-9ae0-06ab791c7aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:47.935529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ffa8f-1e26-4be8-9ae0-06ab791c7aba None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:47.935802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ffa8f-1e26-4be8-9ae0-06ab791c7aba None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:47.936092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ffa8f-1e26-4be8-9ae0-06ab791c7aba None admin] PATH_INFO: `/v3/projects/517f6254459d44d198fd5f688b9ddb04/users/a9835e6cd27e4842a65436a567a1a881/roles/35a096ec554741cb99e599760e23fe4d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:47.938382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ffa8f-1e26-4be8-9ae0-06ab791c7aba None admin] RBAC: Authorizing `identity:create_grant(project_id=517f6254459d44d198fd5f688b9ddb04, user_id=a9835e6cd27e4842a65436a567a1a881, role_id=35a096ec554741cb99e599760e23fe4d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:47.939861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ffa8f-1e26-4be8-9ae0-06ab791c7aba None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:47.955902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 556/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:20:47 2022] PUT /identity/v3/projects/517f6254459d44d198fd5f688b9ddb04/users/a9835e6cd27e4842a65436a567a1a881/roles/35a096ec554741cb99e599760e23fe4d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:20:50.064670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d503278-bbbc-4783-87f1-03b88b00f0c8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:50.065239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d503278-bbbc-4783-87f1-03b88b00f0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:50.065239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d503278-bbbc-4783-87f1-03b88b00f0c8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:50.066528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 568/1124] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:50.073198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc0d46-dc2d-47c7-b210-18aa63f9c4e2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:50.073900 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc0d46-dc2d-47c7-b210-18aa63f9c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:50.074049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc0d46-dc2d-47c7-b210-18aa63f9c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:50.099554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e4fc0d46-dc2d-47c7-b210-18aa63f9c4e2 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:50.100753 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e4fc0d46-dc2d-47c7-b210-18aa63f9c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:50.179363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 557/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:50.450097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d503278-bbbc-4783-87f1-03b88b00f0c8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:50.565542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d503278-bbbc-4783-87f1-03b88b00f0c8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:50.595503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:50.601766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d18a-8874-4eab-9f1c-7f23c21f80a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:50.602392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d18a-8874-4eab-9f1c-7f23c21f80a2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:50.602666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d18a-8874-4eab-9f1c-7f23c21f80a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:50.602934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d18a-8874-4eab-9f1c-7f23c21f80a2 None admin] PATH_INFO: `/v3/roles/35a096ec554741cb99e599760e23fe4d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:50.604440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1d18a-8874-4eab-9f1c-7f23c21f80a2 None admin] RBAC: Authorizing `identity:get_role(role_id=35a096ec554741cb99e599760e23fe4d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:50.605803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1d18a-8874-4eab-9f1c-7f23c21f80a2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:50.607118 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 569/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:20:50 2022] GET /identity/v3/roles/35a096ec554741cb99e599760e23fe4d => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:50.613270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc0d46-dc2d-47c7-b210-18aa63f9c4e2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:50.658435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:50.724577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc0d46-dc2d-47c7-b210-18aa63f9c4e2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:50.766945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac933e-c3f5-4586-9577-dc6623889620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:50.767607 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac933e-c3f5-4586-9577-dc6623889620 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:50.767885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac933e-c3f5-4586-9577-dc6623889620 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:50.768159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac933e-c3f5-4586-9577-dc6623889620 None admin] PATH_INFO: `/v3/users/a9835e6cd27e4842a65436a567a1a881` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:50.769343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac933e-c3f5-4586-9577-dc6623889620 None admin] RBAC: Authorizing `identity:get_user(user_id=a9835e6cd27e4842a65436a567a1a881)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:50.770793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac933e-c3f5-4586-9577-dc6623889620 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:50.772427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 558/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:20:50 2022] GET /identity/v3/users/a9835e6cd27e4842a65436a567a1a881 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:50.781007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d18a-8874-4eab-9f1c-7f23c21f80a2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:50.892617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d18a-8874-4eab-9f1c-7f23c21f80a2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:50.928728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f822a7-0a9e-41b9-aa81-af8d77429a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:50.929326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f822a7-0a9e-41b9-aa81-af8d77429a53 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:50.929600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f822a7-0a9e-41b9-aa81-af8d77429a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:50.929863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f822a7-0a9e-41b9-aa81-af8d77429a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:50.995245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:50.997528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f822a7-0a9e-41b9-aa81-af8d77429a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:50.999038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f822a7-0a9e-41b9-aa81-af8d77429a53 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:51.110965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 570/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:20:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:20:51.118024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac933e-c3f5-4586-9577-dc6623889620 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:51.231598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac933e-c3f5-4586-9577-dc6623889620 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:51.240732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:51.268807 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9fa3f-9014-475b-8e68-3ea536ddb743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:51.269406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9fa3f-9014-475b-8e68-3ea536ddb743 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:51.269673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9fa3f-9014-475b-8e68-3ea536ddb743 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:51.269966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9fa3f-9014-475b-8e68-3ea536ddb743 None admin] PATH_INFO: `/v3/projects/517f6254459d44d198fd5f688b9ddb04` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:51.271087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9fa3f-9014-475b-8e68-3ea536ddb743 None admin] RBAC: Authorizing `identity:get_project(project_id=517f6254459d44d198fd5f688b9ddb04)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:51.272547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9fa3f-9014-475b-8e68-3ea536ddb743 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:51.274170 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 559/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:20:51 2022] GET /identity/v3/projects/517f6254459d44d198fd5f688b9ddb04 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:51.280808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f822a7-0a9e-41b9-aa81-af8d77429a53 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:51.380209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:51.385029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f822a7-0a9e-41b9-aa81-af8d77429a53 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:51.428822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addcb50-c515-4412-8f5e-c403cde1de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:51.429427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addcb50-c515-4412-8f5e-c403cde1de90 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:51.429706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addcb50-c515-4412-8f5e-c403cde1de90 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:51.429971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addcb50-c515-4412-8f5e-c403cde1de90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:51.430698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addcb50-c515-4412-8f5e-c403cde1de90 None admin] RBAC: Adding query filter params (role.id=35a096ec554741cb99e599760e23fe4d, scope.project.id=517f6254459d44d198fd5f688b9ddb04, user.id=a9835e6cd27e4842a65436a567a1a881) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:20:51.431002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addcb50-c515-4412-8f5e-c403cde1de90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:51.432462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addcb50-c515-4412-8f5e-c403cde1de90 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:51.438635 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 571/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:20:51 2022] GET /identity/v3/role_assignments?user.id=a9835e6cd27e4842a65436a567a1a881&scope.project.id=517f6254459d44d198fd5f688b9ddb04&role.id=35a096ec554741cb99e599760e23fe4d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:53.592693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234a3e2-4adb-4eec-b167-e513874869d7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:53.593521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234a3e2-4adb-4eec-b167-e513874869d7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:53.593521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234a3e2-4adb-4eec-b167-e513874869d7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:53.595632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 560/1131] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:53.604590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828242c-ac70-4ce6-87e0-b4fb43dde916 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:53.605004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828242c-ac70-4ce6-87e0-b4fb43dde916 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:53.605148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828242c-ac70-4ce6-87e0-b4fb43dde916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:53.630445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3828242c-ac70-4ce6-87e0-b4fb43dde916 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:53.631674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3828242c-ac70-4ce6-87e0-b4fb43dde916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:53.700366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 572/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:53.962832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234a3e2-4adb-4eec-b167-e513874869d7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:54.080238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234a3e2-4adb-4eec-b167-e513874869d7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:54.115076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff28c2-e44f-4f1a-9e62-f2c40d1b51ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:54.115719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff28c2-e44f-4f1a-9e62-f2c40d1b51ac None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:54.116354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff28c2-e44f-4f1a-9e62-f2c40d1b51ac None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:54.116617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff28c2-e44f-4f1a-9e62-f2c40d1b51ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:54.117842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff28c2-e44f-4f1a-9e62-f2c40d1b51ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:54.119275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff28c2-e44f-4f1a-9e62-f2c40d1b51ac None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:54.120844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 561/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:54.127213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828242c-ac70-4ce6-87e0-b4fb43dde916 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:54.234042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:54.241784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828242c-ac70-4ce6-87e0-b4fb43dde916 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:54.276904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493fbc3-336d-464f-be05-4746d0a36d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:54.277511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493fbc3-336d-464f-be05-4746d0a36d44 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:54.277785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493fbc3-336d-464f-be05-4746d0a36d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:54.278055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493fbc3-336d-464f-be05-4746d0a36d44 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:54.278698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493fbc3-336d-464f-be05-4746d0a36d44 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:54.280253 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493fbc3-336d-464f-be05-4746d0a36d44 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:54.311623 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 573/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:20:54 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:20:56.455962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd9734-af5b-4b38-8ee5-4482544d38ea None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:56.456879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd9734-af5b-4b38-8ee5-4482544d38ea None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:56.456879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd9734-af5b-4b38-8ee5-4482544d38ea None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:56.459001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 562/1135] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:56.465546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827542b-f8be-4a93-88b0-f81ee729441b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:56.466231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827542b-f8be-4a93-88b0-f81ee729441b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:56.466393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827542b-f8be-4a93-88b0-f81ee729441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:56.492260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f827542b-f8be-4a93-88b0-f81ee729441b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:56.493456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f827542b-f8be-4a93-88b0-f81ee729441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:56.578726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 574/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:56.846553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd9734-af5b-4b38-8ee5-4482544d38ea None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:56.912237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:56.971802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd9734-af5b-4b38-8ee5-4482544d38ea None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:57.007485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60379fa-caa7-40f9-bb2f-50f860f0f21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:57.008105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60379fa-caa7-40f9-bb2f-50f860f0f21e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:57.008377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60379fa-caa7-40f9-bb2f-50f860f0f21e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:57.008643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60379fa-caa7-40f9-bb2f-50f860f0f21e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:57.009856 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60379fa-caa7-40f9-bb2f-50f860f0f21e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:57.011301 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60379fa-caa7-40f9-bb2f-50f860f0f21e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:57.012899 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 563/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:20:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:20:57.019078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827542b-f8be-4a93-88b0-f81ee729441b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:57.097210 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:57.125628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827542b-f8be-4a93-88b0-f81ee729441b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:57.161276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2b7b3-f28b-47dd-ac36-29a03266bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:57.161883 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2b7b3-f28b-47dd-ac36-29a03266bbf8 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:57.162160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2b7b3-f28b-47dd-ac36-29a03266bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:57.162425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2b7b3-f28b-47dd-ac36-29a03266bbf8 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:57.163074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2b7b3-f28b-47dd-ac36-29a03266bbf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:20:57.164550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2b7b3-f28b-47dd-ac36-29a03266bbf8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:20:57.189442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 575/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:20:57 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:20:59.393879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3197-3109-4c97-b3cd-d20251b57169 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:59.394754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3197-3109-4c97-b3cd-d20251b57169 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:59.394754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3197-3109-4c97-b3cd-d20251b57169 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:59.396959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 564/1139] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:20:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:20:59.403203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b74abf-d093-4a91-87e9-53f02103abc6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:59.403679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b74abf-d093-4a91-87e9-53f02103abc6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:59.403771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b74abf-d093-4a91-87e9-53f02103abc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:59.427127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-80b74abf-d093-4a91-87e9-53f02103abc6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:20:59.428338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-80b74abf-d093-4a91-87e9-53f02103abc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:20:59.500732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 576/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:20:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:20:59.765998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df3197-3109-4c97-b3cd-d20251b57169 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:20:59.882649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df3197-3109-4c97-b3cd-d20251b57169 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:20:59.895720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:20:59.919560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a611b7-6b70-42cc-a767-f9803103034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:20:59.920423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a611b7-6b70-42cc-a767-f9803103034c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:20:59.920865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a611b7-6b70-42cc-a767-f9803103034c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:20:59.921142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a611b7-6b70-42cc-a767-f9803103034c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:20:59.931873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a611b7-6b70-42cc-a767-f9803103034c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a0a611b7-6b70-42cc-a767-f9803103034c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:20:59.936923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:20:59.937991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:20:59.938912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 565/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:20:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:20:59.944456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b74abf-d093-4a91-87e9-53f02103abc6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:00.010117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:00.053077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b74abf-d093-4a91-87e9-53f02103abc6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:00.087119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dda732-d8c1-4a45-8146-73f98150d158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:00.087743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dda732-d8c1-4a45-8146-73f98150d158 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:00.088014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dda732-d8c1-4a45-8146-73f98150d158 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:00.088282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dda732-d8c1-4a45-8146-73f98150d158 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:00.088937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dda732-d8c1-4a45-8146-73f98150d158 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:00.089231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dda732-d8c1-4a45-8146-73f98150d158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:00.090598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dda732-d8c1-4a45-8146-73f98150d158 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:00.098775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 577/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:20:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:00.105815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a611b7-6b70-42cc-a767-f9803103034c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:00.213572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a611b7-6b70-42cc-a767-f9803103034c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:00.255839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38233f-fef6-499f-8412-f65c0573b05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:00.256756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38233f-fef6-499f-8412-f65c0573b05a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:00.257134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38233f-fef6-499f-8412-f65c0573b05a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:00.257445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38233f-fef6-499f-8412-f65c0573b05a None admin] PATH_INFO: `/v3/users/06ebf2fe61a4448a9ae4fcfaff95cf19` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:00.273667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38233f-fef6-499f-8412-f65c0573b05a None admin] RBAC: Authorizing `identity:get_user(user_id=06ebf2fe61a4448a9ae4fcfaff95cf19)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:00.275077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38233f-fef6-499f-8412-f65c0573b05a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:00.276713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 566/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:21:00 2022] GET /identity/v3/users/06ebf2fe61a4448a9ae4fcfaff95cf19 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:00.283037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dda732-d8c1-4a45-8146-73f98150d158 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:00.388212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dda732-d8c1-4a45-8146-73f98150d158 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:00.412460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:00.424985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0cb81-407f-41cc-be57-d66655725374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:00.425590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0cb81-407f-41cc-be57-d66655725374 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:00.425865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0cb81-407f-41cc-be57-d66655725374 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:00.426131 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0cb81-407f-41cc-be57-d66655725374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:00.495553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0cb81-407f-41cc-be57-d66655725374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:00.496979 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0cb81-407f-41cc-be57-d66655725374 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:00.601639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 578/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:21:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:21:00.611637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38233f-fef6-499f-8412-f65c0573b05a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:00.648191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:00.719226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38233f-fef6-499f-8412-f65c0573b05a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:00.754842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0031eda-46e3-4fc5-a959-8c24c0854b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:00.755494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0031eda-46e3-4fc5-a959-8c24c0854b33 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:00.755768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0031eda-46e3-4fc5-a959-8c24c0854b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:00.756040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0031eda-46e3-4fc5-a959-8c24c0854b33 None admin] PATH_INFO: `/v3/projects/4da1b5c54224429db0de78743796cac9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:00.757270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0031eda-46e3-4fc5-a959-8c24c0854b33 None admin] RBAC: Authorizing `identity:get_project(project_id=4da1b5c54224429db0de78743796cac9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:00.758715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0031eda-46e3-4fc5-a959-8c24c0854b33 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:00.760361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 567/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:21:00 2022] GET /identity/v3/projects/4da1b5c54224429db0de78743796cac9 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:00.767743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0cb81-407f-41cc-be57-d66655725374 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:00.804688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:00.889088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0cb81-407f-41cc-be57-d66655725374 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:00.934512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47771f9-e6fb-430c-bbf4-e7f1ba4cfc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:00.935096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47771f9-e6fb-430c-bbf4-e7f1ba4cfc88 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:00.935423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47771f9-e6fb-430c-bbf4-e7f1ba4cfc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:00.935681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47771f9-e6fb-430c-bbf4-e7f1ba4cfc88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:00.936419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47771f9-e6fb-430c-bbf4-e7f1ba4cfc88 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=4da1b5c54224429db0de78743796cac9, user.id=06ebf2fe61a4448a9ae4fcfaff95cf19) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:00.936729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47771f9-e6fb-430c-bbf4-e7f1ba4cfc88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:00.938171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47771f9-e6fb-430c-bbf4-e7f1ba4cfc88 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:00.944439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 579/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:21:00 2022] GET /identity/v3/role_assignments?user.id=06ebf2fe61a4448a9ae4fcfaff95cf19&scope.project.id=4da1b5c54224429db0de78743796cac9&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:03.052566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f35407-be27-44cd-8fe4-1ada87d22a99 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:03.053163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f35407-be27-44cd-8fe4-1ada87d22a99 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:03.053163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f35407-be27-44cd-8fe4-1ada87d22a99 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:03.054474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 568/1147] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:21:03.061036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd81f7-a275-439e-bf0d-e459ce3a00fe None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:03.061737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd81f7-a275-439e-bf0d-e459ce3a00fe None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:03.062068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd81f7-a275-439e-bf0d-e459ce3a00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:03.086374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bccd81f7-a275-439e-bf0d-e459ce3a00fe None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:21:03.087602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bccd81f7-a275-439e-bf0d-e459ce3a00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:21:03.160205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 580/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:21:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:21:03.423923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f35407-be27-44cd-8fe4-1ada87d22a99 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:03.530535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:03.536255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f35407-be27-44cd-8fe4-1ada87d22a99 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:03.573574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40152df-65f4-475d-8714-08a027a3ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:03.574125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40152df-65f4-475d-8714-08a027a3ddbd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:03.574393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40152df-65f4-475d-8714-08a027a3ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:03.574656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40152df-65f4-475d-8714-08a027a3ddbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:03.585095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40152df-65f4-475d-8714-08a027a3ddbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d40152df-65f4-475d-8714-08a027a3ddbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:21:03.589783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:21:03.590853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:21:03.592397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 569/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:21:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:21:03.599651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd81f7-a275-439e-bf0d-e459ce3a00fe None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:03.619038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:03.703880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd81f7-a275-439e-bf0d-e459ce3a00fe None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:03.739216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9799f41-8e77-4011-a496-7088c20da818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:03.739850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9799f41-8e77-4011-a496-7088c20da818 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:03.740126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9799f41-8e77-4011-a496-7088c20da818 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:03.740393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9799f41-8e77-4011-a496-7088c20da818 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:03.741413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9799f41-8e77-4011-a496-7088c20da818 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:03.741715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9799f41-8e77-4011-a496-7088c20da818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:03.743082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9799f41-8e77-4011-a496-7088c20da818 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:03.751134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 581/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:21:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:03.757660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40152df-65f4-475d-8714-08a027a3ddbd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:03.869471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40152df-65f4-475d-8714-08a027a3ddbd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:03.913757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ca42c-425c-42c7-99ce-2e5da1183ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:03.914372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ca42c-425c-42c7-99ce-2e5da1183ccc None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:03.914648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ca42c-425c-42c7-99ce-2e5da1183ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:03.914916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ca42c-425c-42c7-99ce-2e5da1183ccc None admin] PATH_INFO: `/v3/users/06ebf2fe61a4448a9ae4fcfaff95cf19` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:03.916131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ca42c-425c-42c7-99ce-2e5da1183ccc None admin] RBAC: Authorizing `identity:get_user(user_id=06ebf2fe61a4448a9ae4fcfaff95cf19)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:03.917607 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ca42c-425c-42c7-99ce-2e5da1183ccc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:03.919213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 570/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:21:03 2022] GET /identity/v3/users/06ebf2fe61a4448a9ae4fcfaff95cf19 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:03.925409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9799f41-8e77-4011-a496-7088c20da818 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:04.014511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:04.035767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9799f41-8e77-4011-a496-7088c20da818 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:04.070514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b30cdc-46e8-4515-a8cb-9603aae8815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:04.071144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b30cdc-46e8-4515-a8cb-9603aae8815c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:04.071426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b30cdc-46e8-4515-a8cb-9603aae8815c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:04.071688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b30cdc-46e8-4515-a8cb-9603aae8815c None admin] PATH_INFO: `/v3/projects/4da1b5c54224429db0de78743796cac9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:04.072847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b30cdc-46e8-4515-a8cb-9603aae8815c None admin] RBAC: Authorizing `identity:get_project(project_id=4da1b5c54224429db0de78743796cac9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:04.074307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b30cdc-46e8-4515-a8cb-9603aae8815c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:04.075992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 582/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:21:03 2022] GET /identity/v3/projects/4da1b5c54224429db0de78743796cac9 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:04.086533 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ca42c-425c-42c7-99ce-2e5da1183ccc None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:04.118669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:04.199161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ca42c-425c-42c7-99ce-2e5da1183ccc None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:04.233036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad4ed1-3d28-4b24-b6e4-c6d8e3351807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:04.233669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4ed1-3d28-4b24-b6e4-c6d8e3351807 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:04.233937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4ed1-3d28-4b24-b6e4-c6d8e3351807 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:04.234201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4ed1-3d28-4b24-b6e4-c6d8e3351807 None admin] PATH_INFO: `/v3/projects/4da1b5c54224429db0de78743796cac9/users/06ebf2fe61a4448a9ae4fcfaff95cf19/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:04.236365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad4ed1-3d28-4b24-b6e4-c6d8e3351807 None admin] RBAC: Authorizing `identity:create_grant(project_id=4da1b5c54224429db0de78743796cac9, user_id=06ebf2fe61a4448a9ae4fcfaff95cf19, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:04.237794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad4ed1-3d28-4b24-b6e4-c6d8e3351807 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:04.253460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 571/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:21:04 2022] PUT /identity/v3/projects/4da1b5c54224429db0de78743796cac9/users/06ebf2fe61a4448a9ae4fcfaff95cf19/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:21:06.345997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23268ed-fdee-4c98-9384-69cf89bd4517 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:06.346496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23268ed-fdee-4c98-9384-69cf89bd4517 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:06.346496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23268ed-fdee-4c98-9384-69cf89bd4517 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:06.347948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 583/1154] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:21:06.354296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b07e-d575-471a-8529-d62ff9d50d3e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:06.354773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b07e-d575-471a-8529-d62ff9d50d3e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:06.354879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b07e-d575-471a-8529-d62ff9d50d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:06.381252 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9776b07e-d575-471a-8529-d62ff9d50d3e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:21:06.382437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9776b07e-d575-471a-8529-d62ff9d50d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:21:06.452844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 572/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:21:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:21:06.727086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23268ed-fdee-4c98-9384-69cf89bd4517 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:06.845500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23268ed-fdee-4c98-9384-69cf89bd4517 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:06.884743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e53b4-250a-4fa9-a200-b7c7bfcbb32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:06.885362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e53b4-250a-4fa9-a200-b7c7bfcbb32d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:06.885633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e53b4-250a-4fa9-a200-b7c7bfcbb32d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:06.885894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e53b4-250a-4fa9-a200-b7c7bfcbb32d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:06.897168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e53b4-250a-4fa9-a200-b7c7bfcbb32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-790e53b4-250a-4fa9-a200-b7c7bfcbb32d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:21:06.901900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:21:06.903025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:21:06.904321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 584/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:21:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:21:06.909145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776b07e-d575-471a-8529-d62ff9d50d3e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:06.926145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:07.011276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776b07e-d575-471a-8529-d62ff9d50d3e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:07.048650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fcee9-04d0-492f-bdbd-b69675dda576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:07.049245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fcee9-04d0-492f-bdbd-b69675dda576 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:07.049518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fcee9-04d0-492f-bdbd-b69675dda576 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:07.049779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fcee9-04d0-492f-bdbd-b69675dda576 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:07.050443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fcee9-04d0-492f-bdbd-b69675dda576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:07.050735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fcee9-04d0-492f-bdbd-b69675dda576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:07.052150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fcee9-04d0-492f-bdbd-b69675dda576 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:07.060347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 573/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:21:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:07.066600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e53b4-250a-4fa9-a200-b7c7bfcbb32d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:07.078097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:07.172394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e53b4-250a-4fa9-a200-b7c7bfcbb32d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:07.208694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a661812-0da2-4005-9093-8633ac0663f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:07.209312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a661812-0da2-4005-9093-8633ac0663f4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:07.209595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a661812-0da2-4005-9093-8633ac0663f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:07.209854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a661812-0da2-4005-9093-8633ac0663f4 None admin] PATH_INFO: `/v3/users/06ebf2fe61a4448a9ae4fcfaff95cf19` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:07.211110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a661812-0da2-4005-9093-8633ac0663f4 None admin] RBAC: Authorizing `identity:get_user(user_id=06ebf2fe61a4448a9ae4fcfaff95cf19)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:07.212578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a661812-0da2-4005-9093-8633ac0663f4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:07.214140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 585/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:21:07 2022] GET /identity/v3/users/06ebf2fe61a4448a9ae4fcfaff95cf19 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:07.223103 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fcee9-04d0-492f-bdbd-b69675dda576 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:07.317053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:07.341097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fcee9-04d0-492f-bdbd-b69675dda576 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:07.375924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27fc85-8022-4fca-947a-2b5d203a63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:07.376548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27fc85-8022-4fca-947a-2b5d203a63e0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:07.376780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27fc85-8022-4fca-947a-2b5d203a63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:07.377040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27fc85-8022-4fca-947a-2b5d203a63e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:07.450268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27fc85-8022-4fca-947a-2b5d203a63e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:07.451908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27fc85-8022-4fca-947a-2b5d203a63e0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:07.530689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:07.553615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 574/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:21:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:21:07.559946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a661812-0da2-4005-9093-8633ac0663f4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:07.647623 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:07.675270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a661812-0da2-4005-9093-8633ac0663f4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:07.710538 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec7fdb-f9a3-4552-877d-7c7254b4b992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:07.711158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec7fdb-f9a3-4552-877d-7c7254b4b992 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:07.711464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec7fdb-f9a3-4552-877d-7c7254b4b992 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:07.711732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec7fdb-f9a3-4552-877d-7c7254b4b992 None admin] PATH_INFO: `/v3/projects/4da1b5c54224429db0de78743796cac9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:07.712990 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec7fdb-f9a3-4552-877d-7c7254b4b992 None admin] RBAC: Authorizing `identity:get_project(project_id=4da1b5c54224429db0de78743796cac9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:07.714417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec7fdb-f9a3-4552-877d-7c7254b4b992 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:07.716068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 586/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:21:07 2022] GET /identity/v3/projects/4da1b5c54224429db0de78743796cac9 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:21:07.725971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27fc85-8022-4fca-947a-2b5d203a63e0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:07.834468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27fc85-8022-4fca-947a-2b5d203a63e0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:07.871282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132195d-f7f8-485f-a3e1-45881e721b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:07.871868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132195d-f7f8-485f-a3e1-45881e721b16 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:07.872170 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132195d-f7f8-485f-a3e1-45881e721b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:07.872439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132195d-f7f8-485f-a3e1-45881e721b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:07.873213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132195d-f7f8-485f-a3e1-45881e721b16 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=4da1b5c54224429db0de78743796cac9, user.id=06ebf2fe61a4448a9ae4fcfaff95cf19) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:07.873516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132195d-f7f8-485f-a3e1-45881e721b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:07.874944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132195d-f7f8-485f-a3e1-45881e721b16 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:07.880770 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 575/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:21:07 2022] GET /identity/v3/role_assignments?user.id=06ebf2fe61a4448a9ae4fcfaff95cf19&scope.project.id=4da1b5c54224429db0de78743796cac9&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:10.031890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b6bbf-13c3-4b9a-b1ac-5f244ece9a4b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:10.032791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b6bbf-13c3-4b9a-b1ac-5f244ece9a4b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:10.032791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b6bbf-13c3-4b9a-b1ac-5f244ece9a4b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:10.034874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 587/1162] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:21:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:21:10.043735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c13a4b-6886-4293-83ca-18e87461e06c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:10.044176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c13a4b-6886-4293-83ca-18e87461e06c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:10.044304 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c13a4b-6886-4293-83ca-18e87461e06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:10.064924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-53c13a4b-6886-4293-83ca-18e87461e06c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:21:10.066139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-53c13a4b-6886-4293-83ca-18e87461e06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:21:10.106085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:10.140283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 576/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:21:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:21:10.416411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b6bbf-13c3-4b9a-b1ac-5f244ece9a4b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:10.525462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b6bbf-13c3-4b9a-b1ac-5f244ece9a4b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:10.561218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc236f8a-5e59-455b-a2ea-a0431ed98cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:10.561811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236f8a-5e59-455b-a2ea-a0431ed98cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:10.562085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236f8a-5e59-455b-a2ea-a0431ed98cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:10.562353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236f8a-5e59-455b-a2ea-a0431ed98cc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:10.576682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:10.644752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc236f8a-5e59-455b-a2ea-a0431ed98cc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:10.646180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc236f8a-5e59-455b-a2ea-a0431ed98cc1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:10.750887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 588/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:21:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:21:10.757219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c13a4b-6886-4293-83ca-18e87461e06c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:10.870634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c13a4b-6886-4293-83ca-18e87461e06c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:10.904972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59950-4cf3-411a-aef5-7900663761fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:10.905600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59950-4cf3-411a-aef5-7900663761fa None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:10.905868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59950-4cf3-411a-aef5-7900663761fa None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:10.906138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59950-4cf3-411a-aef5-7900663761fa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:10.913083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a59950-4cf3-411a-aef5-7900663761fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:10.914528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a59950-4cf3-411a-aef5-7900663761fa None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-e5a59950-4cf3-411a-aef5-7900663761fa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:21:10.926042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:21:10.927212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:21:10.928104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 577/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 6 04:21:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:21:10.934915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc236f8a-5e59-455b-a2ea-a0431ed98cc1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:10.991512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:11.056033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc236f8a-5e59-455b-a2ea-a0431ed98cc1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:11.095814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d6bad-934d-4dc5-a9ca-ec290fe0e871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:11.096413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6bad-934d-4dc5-a9ca-ec290fe0e871 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:11.096690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6bad-934d-4dc5-a9ca-ec290fe0e871 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:11.096957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6bad-934d-4dc5-a9ca-ec290fe0e871 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:11.097599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d6bad-934d-4dc5-a9ca-ec290fe0e871 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:11.097905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d6bad-934d-4dc5-a9ca-ec290fe0e871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:11.099262 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d6bad-934d-4dc5-a9ca-ec290fe0e871 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:11.106532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 589/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Oct 6 04:21:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:21:13.226220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd6967-d4e2-49d0-a5de-dd8924438ed9 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:13.227113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd6967-d4e2-49d0-a5de-dd8924438ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:13.227113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd6967-d4e2-49d0-a5de-dd8924438ed9 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:13.229273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 578/1167] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:21:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:21:13.234797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4be7f3-20f7-495c-9a66-ba2ba6ae5241 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:13.235231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4be7f3-20f7-495c-9a66-ba2ba6ae5241 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:13.235358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4be7f3-20f7-495c-9a66-ba2ba6ae5241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:13.255067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1b4be7f3-20f7-495c-9a66-ba2ba6ae5241 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:21:13.256278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1b4be7f3-20f7-495c-9a66-ba2ba6ae5241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:21:13.328817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 590/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:21:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:21:13.592614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd6967-d4e2-49d0-a5de-dd8924438ed9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:13.635487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:13.713698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd6967-d4e2-49d0-a5de-dd8924438ed9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:13.752574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed30cd-2bda-421d-af13-99908f740ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:13.753443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed30cd-2bda-421d-af13-99908f740ac9 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:13.753814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed30cd-2bda-421d-af13-99908f740ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:13.754162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed30cd-2bda-421d-af13-99908f740ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:13.755157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed30cd-2bda-421d-af13-99908f740ac9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:13.757323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed30cd-2bda-421d-af13-99908f740ac9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:13.777970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 579/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Thu Oct 6 04:21:13 2022] POST /identity/v3/domains => generated 267 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:21:15.949551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe4d50-3c43-49dc-ba17-20480df7e995 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:15.950151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe4d50-3c43-49dc-ba17-20480df7e995 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:15.950151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe4d50-3c43-49dc-ba17-20480df7e995 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:15.951513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 591/1170] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:21:15.958009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b498df3-d300-4777-99aa-eb43479512eb None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:15.958711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b498df3-d300-4777-99aa-eb43479512eb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:15.958896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b498df3-d300-4777-99aa-eb43479512eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:15.987350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8b498df3-d300-4777-99aa-eb43479512eb None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:21:15.988575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8b498df3-d300-4777-99aa-eb43479512eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:21:16.062771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 580/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:21:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:21:16.339291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe4d50-3c43-49dc-ba17-20480df7e995 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:16.382538 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:16.447628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe4d50-3c43-49dc-ba17-20480df7e995 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:16.496729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4b5b5-905c-4302-b815-9ef99da7c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:16.497347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b5b5-905c-4302-b815-9ef99da7c91d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:16.497615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b5b5-905c-4302-b815-9ef99da7c91d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:16.497858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b5b5-905c-4302-b815-9ef99da7c91d None admin] PATH_INFO: `/v3/domains/4d33175a469d48c7ae996f8b8bb0b0d4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:16.509411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4b5b5-905c-4302-b815-9ef99da7c91d None admin] RBAC: Authorizing `identity:get_domain(domain_id=4d33175a469d48c7ae996f8b8bb0b0d4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:16.510849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4b5b5-905c-4302-b815-9ef99da7c91d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:16.512472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 592/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Oct 6 04:21:16 2022] GET /identity/v3/domains/4d33175a469d48c7ae996f8b8bb0b0d4 => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:16.519220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b498df3-d300-4777-99aa-eb43479512eb None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:16.553091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:16.636461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b498df3-d300-4777-99aa-eb43479512eb None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:16.671802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ac904-42a4-42b3-8a59-3fde365978d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:16.672397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ac904-42a4-42b3-8a59-3fde365978d7 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:16.672666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ac904-42a4-42b3-8a59-3fde365978d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:16.672927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ac904-42a4-42b3-8a59-3fde365978d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:16.673561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ac904-42a4-42b3-8a59-3fde365978d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:16.674995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ac904-42a4-42b3-8a59-3fde365978d7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:16.706778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 581/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:21:16 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:21:18.876671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14245-531b-494d-a758-67714aae76fb None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:18.877542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14245-531b-494d-a758-67714aae76fb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:18.877542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14245-531b-494d-a758-67714aae76fb None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:18.879755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 593/1174] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:21:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:21:18.886186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c8e6-4793-410c-b806-0056da5aa733 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:18.886630 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c8e6-4793-410c-b806-0056da5aa733 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:18.886731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c8e6-4793-410c-b806-0056da5aa733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:18.906310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1c61c8e6-4793-410c-b806-0056da5aa733 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:21:18.907510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1c61c8e6-4793-410c-b806-0056da5aa733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:21:18.978632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 582/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:21:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:21:19.244502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14245-531b-494d-a758-67714aae76fb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:19.360236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:19.365957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14245-531b-494d-a758-67714aae76fb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:19.402486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bd3c3-2b34-459c-819e-9d16716543a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:19.403116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd3c3-2b34-459c-819e-9d16716543a2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:19.403416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd3c3-2b34-459c-819e-9d16716543a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:19.403723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd3c3-2b34-459c-819e-9d16716543a2 None admin] PATH_INFO: `/v3/domains/4d33175a469d48c7ae996f8b8bb0b0d4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:19.404887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bd3c3-2b34-459c-819e-9d16716543a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4d33175a469d48c7ae996f8b8bb0b0d4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:19.406311 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bd3c3-2b34-459c-819e-9d16716543a2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:19.407899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 594/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Oct 6 04:21:19 2022] GET /identity/v3/domains/4d33175a469d48c7ae996f8b8bb0b0d4 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:19.417093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61c8e6-4793-410c-b806-0056da5aa733 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:19.421345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:19.526525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61c8e6-4793-410c-b806-0056da5aa733 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:19.562019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5d50b-0cd5-4566-b7f9-d87649dbb175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:19.562608 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d50b-0cd5-4566-b7f9-d87649dbb175 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:19.562876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d50b-0cd5-4566-b7f9-d87649dbb175 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:19.563140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d50b-0cd5-4566-b7f9-d87649dbb175 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:19.563799 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5d50b-0cd5-4566-b7f9-d87649dbb175 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:19.565238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5d50b-0cd5-4566-b7f9-d87649dbb175 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:19.587852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 583/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:21:19 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:21:21.761232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3361-3ce9-47e0-b194-14003b742fca None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:21.762134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3361-3ce9-47e0-b194-14003b742fca None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:21.762134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3361-3ce9-47e0-b194-14003b742fca None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:21.763914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 595/1178] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:21:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:21:21.770371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0f37-58da-4eb8-a261-9773192ba44b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:21.771090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0f37-58da-4eb8-a261-9773192ba44b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:21.771222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0f37-58da-4eb8-a261-9773192ba44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:21.799188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9d1b0f37-58da-4eb8-a261-9773192ba44b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:21:21.800390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9d1b0f37-58da-4eb8-a261-9773192ba44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:21:21.861664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:21.876056 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 584/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:21:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:21:22.163417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f3361-3ce9-47e0-b194-14003b742fca None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:22.283166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f3361-3ce9-47e0-b194-14003b742fca None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:22.318362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dcdb3-93b2-4080-8dd5-b13f9db72ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:22.318985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dcdb3-93b2-4080-8dd5-b13f9db72ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:22.319252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dcdb3-93b2-4080-8dd5-b13f9db72ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:22.319541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dcdb3-93b2-4080-8dd5-b13f9db72ca9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:22.331190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dcdb3-93b2-4080-8dd5-b13f9db72ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e93dcdb3-93b2-4080-8dd5-b13f9db72ca9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:21:22.335962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:21:22.337020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:21:22.337885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 596/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:21:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:21:22.343346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b0f37-58da-4eb8-a261-9773192ba44b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:22.442071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b0f37-58da-4eb8-a261-9773192ba44b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:22.476962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63a5d-f875-423a-8e4e-4397edf1d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:22.477580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63a5d-f875-423a-8e4e-4397edf1d208 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:22.477848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63a5d-f875-423a-8e4e-4397edf1d208 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:22.478111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63a5d-f875-423a-8e4e-4397edf1d208 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:22.478763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf63a5d-f875-423a-8e4e-4397edf1d208 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:22.479055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf63a5d-f875-423a-8e4e-4397edf1d208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:22.480466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf63a5d-f875-423a-8e4e-4397edf1d208 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:22.488956 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 585/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:21:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:22.495486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dcdb3-93b2-4080-8dd5-b13f9db72ca9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:22.525345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:22.601113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dcdb3-93b2-4080-8dd5-b13f9db72ca9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:22.636355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7359f-8c8b-4db7-ba80-9392951e24b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:22.636971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7359f-8c8b-4db7-ba80-9392951e24b5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:22.637244 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7359f-8c8b-4db7-ba80-9392951e24b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:22.637506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7359f-8c8b-4db7-ba80-9392951e24b5 None admin] PATH_INFO: `/v3/users/db07ab4da8b64078acb8eddcfc910f69` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:22.652101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7359f-8c8b-4db7-ba80-9392951e24b5 None admin] RBAC: Authorizing `identity:get_user(user_id=db07ab4da8b64078acb8eddcfc910f69)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:22.653532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7359f-8c8b-4db7-ba80-9392951e24b5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:22.655125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 597/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:21:22 2022] GET /identity/v3/users/db07ab4da8b64078acb8eddcfc910f69 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:22.661125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63a5d-f875-423a-8e4e-4397edf1d208 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:22.720345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:22.774774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63a5d-f875-423a-8e4e-4397edf1d208 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:22.809349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7aa92-6fab-4291-b26e-206b77677925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:22.809943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7aa92-6fab-4291-b26e-206b77677925 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:22.810214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7aa92-6fab-4291-b26e-206b77677925 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:22.810573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7aa92-6fab-4291-b26e-206b77677925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:22.879293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7aa92-6fab-4291-b26e-206b77677925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:22.880765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7aa92-6fab-4291-b26e-206b77677925 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:22.930972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:22.979880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 586/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:21:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:21:22.986808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7359f-8c8b-4db7-ba80-9392951e24b5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:23.079286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:23.097595 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7359f-8c8b-4db7-ba80-9392951e24b5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:23.134457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5b86-1059-44e0-9617-146951a2d2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:23.135073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5b86-1059-44e0-9617-146951a2d2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:23.135353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5b86-1059-44e0-9617-146951a2d2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:23.135593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5b86-1059-44e0-9617-146951a2d2e2 None admin] PATH_INFO: `/v3/projects/2b6e1793d11e4ab6a668dc082860c105` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:23.136783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c5b86-1059-44e0-9617-146951a2d2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=2b6e1793d11e4ab6a668dc082860c105)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:23.138211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c5b86-1059-44e0-9617-146951a2d2e2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:23.139877 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 598/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:21:22 2022] GET /identity/v3/projects/2b6e1793d11e4ab6a668dc082860c105 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:23.146282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7aa92-6fab-4291-b26e-206b77677925 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:23.251492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7aa92-6fab-4291-b26e-206b77677925 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:23.288216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8976b6-b53d-42f8-b1b3-6514a77e56e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:23.288806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8976b6-b53d-42f8-b1b3-6514a77e56e7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:23.289076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8976b6-b53d-42f8-b1b3-6514a77e56e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:23.289343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8976b6-b53d-42f8-b1b3-6514a77e56e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:23.290050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8976b6-b53d-42f8-b1b3-6514a77e56e7 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=2b6e1793d11e4ab6a668dc082860c105, user.id=db07ab4da8b64078acb8eddcfc910f69) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:23.290353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8976b6-b53d-42f8-b1b3-6514a77e56e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:23.291833 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8976b6-b53d-42f8-b1b3-6514a77e56e7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:23.297836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 587/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:21:23 2022] GET /identity/v3/role_assignments?user.id=db07ab4da8b64078acb8eddcfc910f69&scope.project.id=2b6e1793d11e4ab6a668dc082860c105&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:25.403988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cef8e7-5134-450e-97cb-50431dbb93b2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:25.404585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cef8e7-5134-450e-97cb-50431dbb93b2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:25.404585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cef8e7-5134-450e-97cb-50431dbb93b2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:25.405926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 599/1186] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:21:25.412491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cd583-7055-46a5-be8d-cae08a07286f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:25.413294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cd583-7055-46a5-be8d-cae08a07286f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:25.413421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cd583-7055-46a5-be8d-cae08a07286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:25.434657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5e3cd583-7055-46a5-be8d-cae08a07286f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:21:25.435862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5e3cd583-7055-46a5-be8d-cae08a07286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:21:25.446547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:25.508314 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 588/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:21:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:21:25.786424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cef8e7-5134-450e-97cb-50431dbb93b2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:25.894648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cef8e7-5134-450e-97cb-50431dbb93b2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:25.930407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743be01e-94f1-4ac4-ae81-c037f54a1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:25.931032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be01e-94f1-4ac4-ae81-c037f54a1e2d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:25.931339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be01e-94f1-4ac4-ae81-c037f54a1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:25.931601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be01e-94f1-4ac4-ae81-c037f54a1e2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:25.942393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743be01e-94f1-4ac4-ae81-c037f54a1e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-743be01e-94f1-4ac4-ae81-c037f54a1e2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:21:25.947250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:21:25.948336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:21:25.949267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 600/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:21:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:21:25.955170 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cd583-7055-46a5-be8d-cae08a07286f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:26.067973 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cd583-7055-46a5-be8d-cae08a07286f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:26.103034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114afef-156e-4315-bfc0-928f9e2585ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:26.103663 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114afef-156e-4315-bfc0-928f9e2585ed None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:26.103935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114afef-156e-4315-bfc0-928f9e2585ed None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:26.104195 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114afef-156e-4315-bfc0-928f9e2585ed None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:26.104855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114afef-156e-4315-bfc0-928f9e2585ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:26.105149 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114afef-156e-4315-bfc0-928f9e2585ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:26.106529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114afef-156e-4315-bfc0-928f9e2585ed None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:26.114738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 589/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:21:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:26.123986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743be01e-94f1-4ac4-ae81-c037f54a1e2d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:26.139960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:26.225754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743be01e-94f1-4ac4-ae81-c037f54a1e2d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:26.260907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad5739-696c-4b65-b5c4-12f4654f3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:26.261524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad5739-696c-4b65-b5c4-12f4654f3328 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:26.261798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad5739-696c-4b65-b5c4-12f4654f3328 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:26.262063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad5739-696c-4b65-b5c4-12f4654f3328 None admin] PATH_INFO: `/v3/users/db07ab4da8b64078acb8eddcfc910f69` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:26.263215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad5739-696c-4b65-b5c4-12f4654f3328 None admin] RBAC: Authorizing `identity:get_user(user_id=db07ab4da8b64078acb8eddcfc910f69)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:26.264796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad5739-696c-4b65-b5c4-12f4654f3328 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:26.266368 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 601/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:21:26 2022] GET /identity/v3/users/db07ab4da8b64078acb8eddcfc910f69 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:26.272531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114afef-156e-4315-bfc0-928f9e2585ed None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:26.285323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:26.393069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114afef-156e-4315-bfc0-928f9e2585ed None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:26.429011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcb003-4e09-409f-aa97-54883403a2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:26.429594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcb003-4e09-409f-aa97-54883403a2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:26.429894 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcb003-4e09-409f-aa97-54883403a2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:26.430161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcb003-4e09-409f-aa97-54883403a2a0 None admin] PATH_INFO: `/v3/projects/2b6e1793d11e4ab6a668dc082860c105` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:26.431452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcb003-4e09-409f-aa97-54883403a2a0 None admin] RBAC: Authorizing `identity:get_project(project_id=2b6e1793d11e4ab6a668dc082860c105)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:26.432896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcb003-4e09-409f-aa97-54883403a2a0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:26.434533 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 590/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:21:26 2022] GET /identity/v3/projects/2b6e1793d11e4ab6a668dc082860c105 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:26.441623 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad5739-696c-4b65-b5c4-12f4654f3328 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:26.531253 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:26.550835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad5739-696c-4b65-b5c4-12f4654f3328 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:26.585379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc13be3-0048-447a-a5a0-9e29a53f122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:26.586022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13be3-0048-447a-a5a0-9e29a53f122b None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:26.586299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13be3-0048-447a-a5a0-9e29a53f122b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:26.586568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13be3-0048-447a-a5a0-9e29a53f122b None admin] PATH_INFO: `/v3/projects/2b6e1793d11e4ab6a668dc082860c105/users/db07ab4da8b64078acb8eddcfc910f69/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:26.588592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc13be3-0048-447a-a5a0-9e29a53f122b None admin] RBAC: Authorizing `identity:create_grant(project_id=2b6e1793d11e4ab6a668dc082860c105, user_id=db07ab4da8b64078acb8eddcfc910f69, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:26.590018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc13be3-0048-447a-a5a0-9e29a53f122b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:26.604437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 602/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:21:26 2022] PUT /identity/v3/projects/2b6e1793d11e4ab6a668dc082860c105/users/db07ab4da8b64078acb8eddcfc910f69/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:21:28.700719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0d21-8503-40d2-bc4e-8b320d22aec2 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:28.701296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0d21-8503-40d2-bc4e-8b320d22aec2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:28.701296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0d21-8503-40d2-bc4e-8b320d22aec2 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:28.702670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 591/1193] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:21:28.709023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04069f59-aa0e-47f5-88ff-2bd5e0edf450 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:28.709792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04069f59-aa0e-47f5-88ff-2bd5e0edf450 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:28.709995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04069f59-aa0e-47f5-88ff-2bd5e0edf450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:28.738010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-04069f59-aa0e-47f5-88ff-2bd5e0edf450 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:21:28.739211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-04069f59-aa0e-47f5-88ff-2bd5e0edf450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:21:28.813336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 603/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:21:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:21:29.080568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0d21-8503-40d2-bc4e-8b320d22aec2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:29.173902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:29.210383 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0d21-8503-40d2-bc4e-8b320d22aec2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:29.246033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0411dd-d081-40d5-8aa4-c3678c743efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:29.246642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0411dd-d081-40d5-8aa4-c3678c743efd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:29.246914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0411dd-d081-40d5-8aa4-c3678c743efd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:29.247176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0411dd-d081-40d5-8aa4-c3678c743efd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:29.257215 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0411dd-d081-40d5-8aa4-c3678c743efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-5c0411dd-d081-40d5-8aa4-c3678c743efd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:21:29.261949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:21:29.263036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:21:29.264012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 592/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:21:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:21:29.271331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04069f59-aa0e-47f5-88ff-2bd5e0edf450 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:29.350478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:29.383836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04069f59-aa0e-47f5-88ff-2bd5e0edf450 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:29.418759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce876dd-81a8-49ae-809a-01ceba154f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:29.419375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce876dd-81a8-49ae-809a-01ceba154f7c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:29.419911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce876dd-81a8-49ae-809a-01ceba154f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:29.420181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce876dd-81a8-49ae-809a-01ceba154f7c None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:29.420855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce876dd-81a8-49ae-809a-01ceba154f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:29.421155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce876dd-81a8-49ae-809a-01ceba154f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:29.422528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce876dd-81a8-49ae-809a-01ceba154f7c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:29.430836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 604/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:21:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:29.437181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0411dd-d081-40d5-8aa4-c3678c743efd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:29.548708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0411dd-d081-40d5-8aa4-c3678c743efd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:29.584755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf81c49-c8ef-4f1c-bd64-2cee39a54379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:29.585364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf81c49-c8ef-4f1c-bd64-2cee39a54379 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:29.585633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf81c49-c8ef-4f1c-bd64-2cee39a54379 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:29.585893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf81c49-c8ef-4f1c-bd64-2cee39a54379 None admin] PATH_INFO: `/v3/users/db07ab4da8b64078acb8eddcfc910f69` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:29.587127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf81c49-c8ef-4f1c-bd64-2cee39a54379 None admin] RBAC: Authorizing `identity:get_user(user_id=db07ab4da8b64078acb8eddcfc910f69)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:29.588591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf81c49-c8ef-4f1c-bd64-2cee39a54379 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:29.590148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 593/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Oct 6 04:21:29 2022] GET /identity/v3/users/db07ab4da8b64078acb8eddcfc910f69 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:21:29.596526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce876dd-81a8-49ae-809a-01ceba154f7c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:29.699998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce876dd-81a8-49ae-809a-01ceba154f7c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:29.729101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:29.734876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04eea8-e06f-46ab-8749-50ddcdfd0466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:29.735502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04eea8-e06f-46ab-8749-50ddcdfd0466 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:29.735779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04eea8-e06f-46ab-8749-50ddcdfd0466 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:29.736047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04eea8-e06f-46ab-8749-50ddcdfd0466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:29.810375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04eea8-e06f-46ab-8749-50ddcdfd0466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:29.811958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04eea8-e06f-46ab-8749-50ddcdfd0466 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:29.913654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 605/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:21:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 04:21:29.920179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf81c49-c8ef-4f1c-bd64-2cee39a54379 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:29.924552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:30.025621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf81c49-c8ef-4f1c-bd64-2cee39a54379 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:30.062266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef60258-5a30-466a-a57b-a00de9c02e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:30.062880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef60258-5a30-466a-a57b-a00de9c02e5e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:30.063157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef60258-5a30-466a-a57b-a00de9c02e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:30.063444 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef60258-5a30-466a-a57b-a00de9c02e5e None admin] PATH_INFO: `/v3/projects/2b6e1793d11e4ab6a668dc082860c105` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:30.064646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef60258-5a30-466a-a57b-a00de9c02e5e None admin] RBAC: Authorizing `identity:get_project(project_id=2b6e1793d11e4ab6a668dc082860c105)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:30.066097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef60258-5a30-466a-a57b-a00de9c02e5e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:30.067769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 594/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Oct 6 04:21:29 2022] GET /identity/v3/projects/2b6e1793d11e4ab6a668dc082860c105 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:30.077549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04eea8-e06f-46ab-8749-50ddcdfd0466 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:21:30.108177 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:30.181034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04eea8-e06f-46ab-8749-50ddcdfd0466 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:21:30.215073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842275b-f780-4293-817e-ed26a150e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:21:30.215694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842275b-f780-4293-817e-ed26a150e829 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:21:30.215964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842275b-f780-4293-817e-ed26a150e829 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:21:30.216225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842275b-f780-4293-817e-ed26a150e829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:21:30.216973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842275b-f780-4293-817e-ed26a150e829 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=2b6e1793d11e4ab6a668dc082860c105, user.id=db07ab4da8b64078acb8eddcfc910f69) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:21:30.217273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842275b-f780-4293-817e-ed26a150e829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:21:30.218677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842275b-f780-4293-817e-ed26a150e829 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:21:30.224446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 606/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:21:30 2022] GET /identity/v3/role_assignments?user.id=db07ab4da8b64078acb8eddcfc910f69&scope.project.id=2b6e1793d11e4ab6a668dc082860c105&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:21:40.056832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=64 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:21:40.221785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=52 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:25.921707 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d21ff-a860-4d33-b404-fc94f151986a None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:25.922300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d21ff-a860-4d33-b404-fc94f151986a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:25.922413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d21ff-a860-4d33-b404-fc94f151986a None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:25.924371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 595/1201] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:22:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:22:25.930067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3f93-1b61-4fe0-a300-f28a424b16a9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:25.930590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3f93-1b61-4fe0-a300-f28a424b16a9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:25.930590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3f93-1b61-4fe0-a300-f28a424b16a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:25.950462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cdaa3f93-1b61-4fe0-a300-f28a424b16a9 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:22:25.951914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cdaa3f93-1b61-4fe0-a300-f28a424b16a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:22:26.047423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 607/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:22:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 04:22:26.324106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d21ff-a860-4d33-b404-fc94f151986a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:26.449705 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d21ff-a860-4d33-b404-fc94f151986a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:26.498079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887ce8f-b509-4eeb-bcc8-0b9d72add7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:26.498859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887ce8f-b509-4eeb-bcc8-0b9d72add7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:26.499428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887ce8f-b509-4eeb-bcc8-0b9d72add7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:26.499799 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887ce8f-b509-4eeb-bcc8-0b9d72add7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:26.513068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887ce8f-b509-4eeb-bcc8-0b9d72add7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:26.514934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887ce8f-b509-4eeb-bcc8-0b9d72add7d2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-2887ce8f-b509-4eeb-bcc8-0b9d72add7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:26.534787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:26.539853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:26.541256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:26.541256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:26.541256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:26.541256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 596/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:26.542488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa3f93-1b61-4fe0-a300-f28a424b16a9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:26.658064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa3f93-1b61-4fe0-a300-f28a424b16a9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:26.703064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:26.709881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58101af-5619-4cd5-9c79-611ea3ed9cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:26.710616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58101af-5619-4cd5-9c79-611ea3ed9cae None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:26.710874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58101af-5619-4cd5-9c79-611ea3ed9cae None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:26.711179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58101af-5619-4cd5-9c79-611ea3ed9cae None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:26.711896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58101af-5619-4cd5-9c79-611ea3ed9cae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:26.712201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58101af-5619-4cd5-9c79-611ea3ed9cae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:26.713576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58101af-5619-4cd5-9c79-611ea3ed9cae None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:26.727413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 608/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:26.734697 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887ce8f-b509-4eeb-bcc8-0b9d72add7d2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:26.804814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:26.864607 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887ce8f-b509-4eeb-bcc8-0b9d72add7d2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:26.902094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59d4b1-4767-4cf2-b4fc-f382177c2bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:26.902699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d4b1-4767-4cf2-b4fc-f382177c2bee None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:26.902971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d4b1-4767-4cf2-b4fc-f382177c2bee None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:26.903238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d4b1-4767-4cf2-b4fc-f382177c2bee None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:26.903909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59d4b1-4767-4cf2-b4fc-f382177c2bee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:26.905467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59d4b1-4767-4cf2-b4fc-f382177c2bee None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:26.936816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 597/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Oct 6 04:22:26 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:22:29.308469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66a00-8cf8-4eb6-ab05-bf50902e99ec None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:29.309006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66a00-8cf8-4eb6-ab05-bf50902e99ec None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:29.309575 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66a00-8cf8-4eb6-ab05-bf50902e99ec None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:29.310599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 609/1206] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:22:29.318464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247558d-f8c3-4960-b086-c6810e973ff8 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:29.318464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247558d-f8c3-4960-b086-c6810e973ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:29.318464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247558d-f8c3-4960-b086-c6810e973ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:29.337816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3247558d-f8c3-4960-b086-c6810e973ff8 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:22:29.339234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3247558d-f8c3-4960-b086-c6810e973ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:22:29.415724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 598/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:22:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:22:29.693151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66a00-8cf8-4eb6-ab05-bf50902e99ec None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:29.818583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66a00-8cf8-4eb6-ab05-bf50902e99ec None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:29.860328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdba0b-1f3d-437f-baaa-04a778bdfb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:29.860958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdba0b-1f3d-437f-baaa-04a778bdfb09 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:29.861249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdba0b-1f3d-437f-baaa-04a778bdfb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:29.861501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdba0b-1f3d-437f-baaa-04a778bdfb09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:29.874925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdba0b-1f3d-437f-baaa-04a778bdfb09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-68bdba0b-1f3d-437f-baaa-04a778bdfb09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:22:29.881096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:29.883839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:29.884716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 610/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:22:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:29.888685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247558d-f8c3-4960-b086-c6810e973ff8 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:29.942836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:30.028467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247558d-f8c3-4960-b086-c6810e973ff8 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:30.072005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362c41b-98cc-439e-8424-b68c63d3d1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:30.074844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362c41b-98cc-439e-8424-b68c63d3d1ca None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:30.074844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362c41b-98cc-439e-8424-b68c63d3d1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:30.074844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362c41b-98cc-439e-8424-b68c63d3d1ca None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:30.074844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362c41b-98cc-439e-8424-b68c63d3d1ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:30.074844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362c41b-98cc-439e-8424-b68c63d3d1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:30.075859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362c41b-98cc-439e-8424-b68c63d3d1ca None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:30.084637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 599/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:22:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:30.091388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdba0b-1f3d-437f-baaa-04a778bdfb09 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:30.147853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:30.209440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdba0b-1f3d-437f-baaa-04a778bdfb09 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:30.250778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c12eb-1358-418c-8738-0274a84e0777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:30.251746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c12eb-1358-418c-8738-0274a84e0777 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:30.252179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c12eb-1358-418c-8738-0274a84e0777 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:30.252574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c12eb-1358-418c-8738-0274a84e0777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:30.264973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c12eb-1358-418c-8738-0274a84e0777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:30.266606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c12eb-1358-418c-8738-0274a84e0777 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-089c12eb-1358-418c-8738-0274a84e0777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:30.282872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:30.284222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:30.285365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:30.285365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:30.285365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:30.287657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 611/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:30.290410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362c41b-98cc-439e-8424-b68c63d3d1ca None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:30.405245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:30.409219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362c41b-98cc-439e-8424-b68c63d3d1ca None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:30.452966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117d57c-de92-488f-9fc6-30b5cd8a1b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:30.453832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117d57c-de92-488f-9fc6-30b5cd8a1b97 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:30.454157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117d57c-de92-488f-9fc6-30b5cd8a1b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:30.454462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117d57c-de92-488f-9fc6-30b5cd8a1b97 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:30.456068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117d57c-de92-488f-9fc6-30b5cd8a1b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:30.456068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117d57c-de92-488f-9fc6-30b5cd8a1b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:30.456968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117d57c-de92-488f-9fc6-30b5cd8a1b97 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:30.472629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 600/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:22:30.478469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c12eb-1358-418c-8738-0274a84e0777 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:30.598622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c12eb-1358-418c-8738-0274a84e0777 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:30.600833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:30.640996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f7252-020e-4598-a410-6c6ac95d3185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:30.641642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f7252-020e-4598-a410-6c6ac95d3185 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:30.641918 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f7252-020e-4598-a410-6c6ac95d3185 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:30.642186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f7252-020e-4598-a410-6c6ac95d3185 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:30.651607 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f7252-020e-4598-a410-6c6ac95d3185 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:30.656598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f7252-020e-4598-a410-6c6ac95d3185 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e32f7252-020e-4598-a410-6c6ac95d3185 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:22:30.671941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:30.673144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:30.674153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 612/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:30.679885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117d57c-de92-488f-9fc6-30b5cd8a1b97 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:30.803399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117d57c-de92-488f-9fc6-30b5cd8a1b97 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:30.846633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda20332-d4cb-41b2-b7d9-5b89c66b136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:30.847376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda20332-d4cb-41b2-b7d9-5b89c66b136d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:30.847561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda20332-d4cb-41b2-b7d9-5b89c66b136d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:30.847812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda20332-d4cb-41b2-b7d9-5b89c66b136d None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:30.848547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda20332-d4cb-41b2-b7d9-5b89c66b136d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:30.849310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda20332-d4cb-41b2-b7d9-5b89c66b136d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:30.850330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda20332-d4cb-41b2-b7d9-5b89c66b136d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:30.869442 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 601/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Oct 6 04:22:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:22:30.875666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f7252-020e-4598-a410-6c6ac95d3185 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:30.994906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f7252-020e-4598-a410-6c6ac95d3185 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:31.052299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3bfb3-3a4d-44d0-bb7a-c032cbbd396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:31.053557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3bfb3-3a4d-44d0-bb7a-c032cbbd396b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:31.053557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3bfb3-3a4d-44d0-bb7a-c032cbbd396b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:31.053763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3bfb3-3a4d-44d0-bb7a-c032cbbd396b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:31.092775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:31.145510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3bfb3-3a4d-44d0-bb7a-c032cbbd396b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:31.147180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3bfb3-3a4d-44d0-bb7a-c032cbbd396b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:31.265019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 613/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:22:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 04:22:31.271139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda20332-d4cb-41b2-b7d9-5b89c66b136d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:31.292185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:31.396480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda20332-d4cb-41b2-b7d9-5b89c66b136d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:31.437160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59080b4-cc0e-41c8-8c65-190b76463974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:31.438571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59080b4-cc0e-41c8-8c65-190b76463974 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:31.438987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59080b4-cc0e-41c8-8c65-190b76463974 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:31.439501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59080b4-cc0e-41c8-8c65-190b76463974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:31.451259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59080b4-cc0e-41c8-8c65-190b76463974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:31.453208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59080b4-cc0e-41c8-8c65-190b76463974 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c59080b4-cc0e-41c8-8c65-190b76463974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:31.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:31.475738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:31.476814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:31.476814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:31.476814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:31.476814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 602/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:31.477941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3bfb3-3a4d-44d0-bb7a-c032cbbd396b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:31.551172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:31.593574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3bfb3-3a4d-44d0-bb7a-c032cbbd396b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:31.629051 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d692d26-3b9b-4e90-a09d-e79746eb3e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:31.629821 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692d26-3b9b-4e90-a09d-e79746eb3e05 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:31.630279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692d26-3b9b-4e90-a09d-e79746eb3e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:31.630581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692d26-3b9b-4e90-a09d-e79746eb3e05 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:31.631372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d692d26-3b9b-4e90-a09d-e79746eb3e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:31.631765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d692d26-3b9b-4e90-a09d-e79746eb3e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:31.633237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d692d26-3b9b-4e90-a09d-e79746eb3e05 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:31.645220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 614/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:31.650858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59080b4-cc0e-41c8-8c65-190b76463974 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:31.730772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:31.766930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59080b4-cc0e-41c8-8c65-190b76463974 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:31.814408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae333736-4b0d-4347-95c9-96746a96b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:31.815158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae333736-4b0d-4347-95c9-96746a96b697 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:31.815520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae333736-4b0d-4347-95c9-96746a96b697 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:31.815852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae333736-4b0d-4347-95c9-96746a96b697 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:31.822962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae333736-4b0d-4347-95c9-96746a96b697 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:31.824581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae333736-4b0d-4347-95c9-96746a96b697 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ae333736-4b0d-4347-95c9-96746a96b697 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:22:31.837858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:31.839044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:31.840041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:22:31.840041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:22:31.840041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:22:31.840041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:22:31.840041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:22:31.840041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:22:31.840041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:31.840041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:31.840041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 603/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:31.845910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d692d26-3b9b-4e90-a09d-e79746eb3e05 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:31.979140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d692d26-3b9b-4e90-a09d-e79746eb3e05 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:32.006174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:32.019688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7e712-3554-4fa2-9f3c-86eab160601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:32.020328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e712-3554-4fa2-9f3c-86eab160601b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:32.020611 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e712-3554-4fa2-9f3c-86eab160601b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:32.020886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e712-3554-4fa2-9f3c-86eab160601b None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:32.021673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7e712-3554-4fa2-9f3c-86eab160601b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:32.022001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7e712-3554-4fa2-9f3c-86eab160601b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:32.023586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7e712-3554-4fa2-9f3c-86eab160601b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:32.038174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 615/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:32.044600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae333736-4b0d-4347-95c9-96746a96b697 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:32.164212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae333736-4b0d-4347-95c9-96746a96b697 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:32.195000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:32.201559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794b18c-d0d2-4a93-9276-ed4717659d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:32.202099 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b18c-d0d2-4a93-9276-ed4717659d8d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:32.202373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b18c-d0d2-4a93-9276-ed4717659d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:32.202638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b18c-d0d2-4a93-9276-ed4717659d8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:32.203469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794b18c-d0d2-4a93-9276-ed4717659d8d None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=ff4e48fdc18e424fa2cf80fd5da332b6) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:32.203775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794b18c-d0d2-4a93-9276-ed4717659d8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:32.205226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794b18c-d0d2-4a93-9276-ed4717659d8d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:32.210978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 604/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:22:32 2022] GET /identity/v3/role_assignments?user.id=ff4e48fdc18e424fa2cf80fd5da332b6&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:34.503992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10970d8-2021-4e29-800a-a0b83bb3b2b2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:34.504593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10970d8-2021-4e29-800a-a0b83bb3b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:34.504593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10970d8-2021-4e29-800a-a0b83bb3b2b2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:34.506179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 616/1220] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:22:34.512391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d5f42-36ae-43aa-bb3c-e12e861e3d1f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:34.512869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d5f42-36ae-43aa-bb3c-e12e861e3d1f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:34.512985 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d5f42-36ae-43aa-bb3c-e12e861e3d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:34.533875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ca9d5f42-36ae-43aa-bb3c-e12e861e3d1f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:22:34.535337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ca9d5f42-36ae-43aa-bb3c-e12e861e3d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:22:34.610591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 605/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:22:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:22:34.874476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10970d8-2021-4e29-800a-a0b83bb3b2b2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:34.982834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10970d8-2021-4e29-800a-a0b83bb3b2b2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:35.021701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abfbcd-3afc-49f3-93c6-035a80d2ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:35.022458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abfbcd-3afc-49f3-93c6-035a80d2ab2a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:35.022823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abfbcd-3afc-49f3-93c6-035a80d2ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:35.023105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abfbcd-3afc-49f3-93c6-035a80d2ab2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:35.034230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abfbcd-3afc-49f3-93c6-035a80d2ab2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-56abfbcd-3afc-49f3-93c6-035a80d2ab2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:22:35.039032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:35.040306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:22:35.041496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:35.045226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 617/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:22:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:22:35.046276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d5f42-36ae-43aa-bb3c-e12e861e3d1f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:35.154223 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d5f42-36ae-43aa-bb3c-e12e861e3d1f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:35.180689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:35.194060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b322e8-e1ce-4ae2-a522-ab7044b9ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:35.194890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b322e8-e1ce-4ae2-a522-ab7044b9ece9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:35.195238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b322e8-e1ce-4ae2-a522-ab7044b9ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:35.195560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b322e8-e1ce-4ae2-a522-ab7044b9ece9 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:35.196341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b322e8-e1ce-4ae2-a522-ab7044b9ece9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:35.196717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b322e8-e1ce-4ae2-a522-ab7044b9ece9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:35.198299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b322e8-e1ce-4ae2-a522-ab7044b9ece9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:35.208924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 606/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:22:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:35.215100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abfbcd-3afc-49f3-93c6-035a80d2ab2a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:35.264347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:35.335176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abfbcd-3afc-49f3-93c6-035a80d2ab2a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:35.373748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15172ae-35b8-4e9d-942b-2c4cbe942da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:35.374476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15172ae-35b8-4e9d-942b-2c4cbe942da9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:35.375528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15172ae-35b8-4e9d-942b-2c4cbe942da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:35.375528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15172ae-35b8-4e9d-942b-2c4cbe942da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:35.387211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15172ae-35b8-4e9d-942b-2c4cbe942da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:35.389109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15172ae-35b8-4e9d-942b-2c4cbe942da9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c15172ae-35b8-4e9d-942b-2c4cbe942da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:35.406536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:35.407724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:35.408920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:35.408920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:35.408920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:35.408920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 618/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:22:35.414309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b322e8-e1ce-4ae2-a522-ab7044b9ece9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:35.531259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b322e8-e1ce-4ae2-a522-ab7044b9ece9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:35.571674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c90c4-1ec3-439d-aa23-8d134a201d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:35.572272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c90c4-1ec3-439d-aa23-8d134a201d6f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:35.572548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c90c4-1ec3-439d-aa23-8d134a201d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:35.572808 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c90c4-1ec3-439d-aa23-8d134a201d6f None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:35.573472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c90c4-1ec3-439d-aa23-8d134a201d6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:35.573740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c90c4-1ec3-439d-aa23-8d134a201d6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:35.575106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c90c4-1ec3-439d-aa23-8d134a201d6f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:35.588345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 607/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:22:35.594522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15172ae-35b8-4e9d-942b-2c4cbe942da9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:35.696989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:35.704634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15172ae-35b8-4e9d-942b-2c4cbe942da9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:35.740947 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589121de-ddc7-4451-b39d-20567039f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:35.741575 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589121de-ddc7-4451-b39d-20567039f236 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:35.741845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589121de-ddc7-4451-b39d-20567039f236 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:35.742104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589121de-ddc7-4451-b39d-20567039f236 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:35.749501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589121de-ddc7-4451-b39d-20567039f236 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:35.750925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589121de-ddc7-4451-b39d-20567039f236 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-589121de-ddc7-4451-b39d-20567039f236 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:22:35.761799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:35.762790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:35.763969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 619/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:35.769173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c90c4-1ec3-439d-aa23-8d134a201d6f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:35.816956 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:35.876387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c90c4-1ec3-439d-aa23-8d134a201d6f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:35.915805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012718-adb4-4521-991a-85c21439f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:35.916485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012718-adb4-4521-991a-85c21439f53c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:35.916684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012718-adb4-4521-991a-85c21439f53c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:35.916942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012718-adb4-4521-991a-85c21439f53c None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:35.917677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d012718-adb4-4521-991a-85c21439f53c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:35.917971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d012718-adb4-4521-991a-85c21439f53c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:35.919430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d012718-adb4-4521-991a-85c21439f53c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:35.936527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 608/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Oct 6 04:22:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:35.942729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589121de-ddc7-4451-b39d-20567039f236 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:36.062999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589121de-ddc7-4451-b39d-20567039f236 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:36.098926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5958f36-b42e-47d9-ae93-6afa53071822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:36.099683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5958f36-b42e-47d9-ae93-6afa53071822 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:36.099963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5958f36-b42e-47d9-ae93-6afa53071822 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:36.100235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5958f36-b42e-47d9-ae93-6afa53071822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:36.113126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5958f36-b42e-47d9-ae93-6afa53071822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:36.114578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5958f36-b42e-47d9-ae93-6afa53071822 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c5958f36-b42e-47d9-ae93-6afa53071822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:36.133759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:36.134994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:36.135973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:36.135973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:36.135973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:36.135973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 620/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:36.141731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012718-adb4-4521-991a-85c21439f53c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:36.258891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012718-adb4-4521-991a-85c21439f53c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:36.262330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:36.300253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5ea89-9873-4b1a-af08-f8642b93a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:36.300866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5ea89-9873-4b1a-af08-f8642b93a918 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:36.301141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5ea89-9873-4b1a-af08-f8642b93a918 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:36.301406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5ea89-9873-4b1a-af08-f8642b93a918 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:36.302053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5ea89-9873-4b1a-af08-f8642b93a918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:36.302372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5ea89-9873-4b1a-af08-f8642b93a918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:36.306482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5ea89-9873-4b1a-af08-f8642b93a918 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:36.323848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 609/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:36.331776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5958f36-b42e-47d9-ae93-6afa53071822 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:36.343349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:36.447708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5958f36-b42e-47d9-ae93-6afa53071822 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:36.491847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973dc77-6310-41e3-a730-21734844e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:36.492882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973dc77-6310-41e3-a730-21734844e579 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:36.493261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973dc77-6310-41e3-a730-21734844e579 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:36.493582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973dc77-6310-41e3-a730-21734844e579 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:36.501670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973dc77-6310-41e3-a730-21734844e579 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:36.503158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973dc77-6310-41e3-a730-21734844e579 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5973dc77-6310-41e3-a730-21734844e579 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:22:36.515648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:36.517041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:36.518447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:22:36.518447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:22:36.518447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:22:36.518447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:22:36.518447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:22:36.518447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:22:36.518447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:36.518447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:36.523000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5ea89-9873-4b1a-af08-f8642b93a918 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:36.523360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 621/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:22:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:36.639826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5ea89-9873-4b1a-af08-f8642b93a918 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:36.679042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41e057-2e6c-4e9f-8c1a-673673f8f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:36.679693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41e057-2e6c-4e9f-8c1a-673673f8f236 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:36.680123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41e057-2e6c-4e9f-8c1a-673673f8f236 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:36.680262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41e057-2e6c-4e9f-8c1a-673673f8f236 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:36.680949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41e057-2e6c-4e9f-8c1a-673673f8f236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:36.681242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41e057-2e6c-4e9f-8c1a-673673f8f236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:36.682703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41e057-2e6c-4e9f-8c1a-673673f8f236 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:36.698690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 610/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:22:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:22:36.705586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973dc77-6310-41e3-a730-21734844e579 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:36.783126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:36.823685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973dc77-6310-41e3-a730-21734844e579 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:36.862184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be6852-8dee-466d-aafd-62b3196c2a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:36.863151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be6852-8dee-466d-aafd-62b3196c2a26 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:36.863461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be6852-8dee-466d-aafd-62b3196c2a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:36.863784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be6852-8dee-466d-aafd-62b3196c2a26 None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/ff4e48fdc18e424fa2cf80fd5da332b6/roles/b62720b095b548c38bc8740a29e49cb2` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:36.883007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be6852-8dee-466d-aafd-62b3196c2a26 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=ff4e48fdc18e424fa2cf80fd5da332b6, role_id=b62720b095b548c38bc8740a29e49cb2)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:36.884491 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be6852-8dee-466d-aafd-62b3196c2a26 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:36.900421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 622/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:22:36 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/ff4e48fdc18e424fa2cf80fd5da332b6/roles/b62720b095b548c38bc8740a29e49cb2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:22:39.081421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895469f9-27a1-4bdf-ae52-55d1adaac6dc None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:39.082004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895469f9-27a1-4bdf-ae52-55d1adaac6dc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:39.082004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895469f9-27a1-4bdf-ae52-55d1adaac6dc None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:39.083326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 611/1233] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:22:39.088630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29a4f-f10c-4bbf-92f2-f502185dabe4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:39.089185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29a4f-f10c-4bbf-92f2-f502185dabe4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:39.089185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29a4f-f10c-4bbf-92f2-f502185dabe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:39.108292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-72e29a4f-f10c-4bbf-92f2-f502185dabe4 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:22:39.109597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-72e29a4f-f10c-4bbf-92f2-f502185dabe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:22:39.179777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 623/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:22:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:22:39.441253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895469f9-27a1-4bdf-ae52-55d1adaac6dc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:39.468969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:39.562804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895469f9-27a1-4bdf-ae52-55d1adaac6dc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:39.600989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f64d-df02-4c91-9bdb-5b1097305c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:39.601695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f64d-df02-4c91-9bdb-5b1097305c02 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:39.601946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f64d-df02-4c91-9bdb-5b1097305c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:39.602263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f64d-df02-4c91-9bdb-5b1097305c02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:39.616198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1f64d-df02-4c91-9bdb-5b1097305c02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-8ff1f64d-df02-4c91-9bdb-5b1097305c02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:22:39.621716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:39.622911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:39.624106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 612/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Oct 6 04:22:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:39.629874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e29a4f-f10c-4bbf-92f2-f502185dabe4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:39.681688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:39.744445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e29a4f-f10c-4bbf-92f2-f502185dabe4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:39.784546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0dec2-c424-4bcf-a351-c6233d2a279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:39.785183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0dec2-c424-4bcf-a351-c6233d2a279f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:39.785474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0dec2-c424-4bcf-a351-c6233d2a279f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:39.785753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0dec2-c424-4bcf-a351-c6233d2a279f None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:39.786428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0dec2-c424-4bcf-a351-c6233d2a279f None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:39.786729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0dec2-c424-4bcf-a351-c6233d2a279f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:39.788161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0dec2-c424-4bcf-a351-c6233d2a279f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:39.796577 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 624/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Oct 6 04:22:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:39.802634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f64d-df02-4c91-9bdb-5b1097305c02 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:39.896347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:39.914274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f64d-df02-4c91-9bdb-5b1097305c02 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:39.957267 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61850f3-53e1-42ee-8646-6c73382737f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:39.957937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61850f3-53e1-42ee-8646-6c73382737f7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:39.958207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61850f3-53e1-42ee-8646-6c73382737f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:39.958478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61850f3-53e1-42ee-8646-6c73382737f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:39.971208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61850f3-53e1-42ee-8646-6c73382737f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:39.972845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61850f3-53e1-42ee-8646-6c73382737f7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-e61850f3-53e1-42ee-8646-6c73382737f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:39.989408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:39.991961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:39.993778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:39.993778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:39.993778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:39.993778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 613/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:39.998350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0dec2-c424-4bcf-a351-c6233d2a279f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:40.103547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0dec2-c424-4bcf-a351-c6233d2a279f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:40.114691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:40.145968 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91cedd-81ec-4a4d-b57f-70c6fcdda689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:40.146889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91cedd-81ec-4a4d-b57f-70c6fcdda689 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:40.147266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91cedd-81ec-4a4d-b57f-70c6fcdda689 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:40.147670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91cedd-81ec-4a4d-b57f-70c6fcdda689 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:40.148655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91cedd-81ec-4a4d-b57f-70c6fcdda689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:40.149161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91cedd-81ec-4a4d-b57f-70c6fcdda689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:40.151169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91cedd-81ec-4a4d-b57f-70c6fcdda689 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:40.164779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 625/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:40.171147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61850f3-53e1-42ee-8646-6c73382737f7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:40.283969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61850f3-53e1-42ee-8646-6c73382737f7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:40.322652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb20a-62ee-4007-aa10-818e85c103f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:40.323372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb20a-62ee-4007-aa10-818e85c103f2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:40.323662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb20a-62ee-4007-aa10-818e85c103f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:40.323944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb20a-62ee-4007-aa10-818e85c103f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:40.326858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:40.333293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cb20a-62ee-4007-aa10-818e85c103f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:40.334759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cb20a-62ee-4007-aa10-818e85c103f2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-5c5cb20a-62ee-4007-aa10-818e85c103f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:22:40.348293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:40.349358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:40.350380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 614/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:22:40.355682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91cedd-81ec-4a4d-b57f-70c6fcdda689 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:40.457809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91cedd-81ec-4a4d-b57f-70c6fcdda689 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:40.497077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7844b-ee57-40e2-917c-c14577678754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:40.497689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7844b-ee57-40e2-917c-c14577678754 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:40.497984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7844b-ee57-40e2-917c-c14577678754 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:40.498287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7844b-ee57-40e2-917c-c14577678754 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:40.499065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7844b-ee57-40e2-917c-c14577678754 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:40.499394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7844b-ee57-40e2-917c-c14577678754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:40.500932 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7844b-ee57-40e2-917c-c14577678754 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:40.519536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 626/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Oct 6 04:22:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:40.525847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb20a-62ee-4007-aa10-818e85c103f2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:40.635097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb20a-62ee-4007-aa10-818e85c103f2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:40.673536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5ad72-1293-49f7-924b-c5000a1a0a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:40.674151 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5ad72-1293-49f7-924b-c5000a1a0a21 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:40.674423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5ad72-1293-49f7-924b-c5000a1a0a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:40.674687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5ad72-1293-49f7-924b-c5000a1a0a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:40.746529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:40.754275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5ad72-1293-49f7-924b-c5000a1a0a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:40.756184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5ad72-1293-49f7-924b-c5000a1a0a21 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:40.872326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 615/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:22:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:22:40.878957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7844b-ee57-40e2-917c-c14577678754 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:40.909155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:40.997831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7844b-ee57-40e2-917c-c14577678754 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:41.033740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c0e64-cf72-453f-bf5e-4794766a8ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:41.034780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c0e64-cf72-453f-bf5e-4794766a8ccc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:41.034780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c0e64-cf72-453f-bf5e-4794766a8ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:41.035069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c0e64-cf72-453f-bf5e-4794766a8ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:41.045588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c0e64-cf72-453f-bf5e-4794766a8ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:41.047046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c0e64-cf72-453f-bf5e-4794766a8ccc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-376c0e64-cf72-453f-bf5e-4794766a8ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:41.063060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:41.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:41.069927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:41.069927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:41.069927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:41.069927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 627/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:41.070233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5ad72-1293-49f7-924b-c5000a1a0a21 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:41.180996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:41.187844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5ad72-1293-49f7-924b-c5000a1a0a21 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:41.224798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e85a1e-5546-4fe3-862f-973e58ed432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:41.225480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e85a1e-5546-4fe3-862f-973e58ed432e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:41.225754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e85a1e-5546-4fe3-862f-973e58ed432e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:41.226020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e85a1e-5546-4fe3-862f-973e58ed432e None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:41.226744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e85a1e-5546-4fe3-862f-973e58ed432e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:41.227086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e85a1e-5546-4fe3-862f-973e58ed432e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:41.228668 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e85a1e-5546-4fe3-862f-973e58ed432e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:41.241627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 616/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:41.248752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c0e64-cf72-453f-bf5e-4794766a8ccc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:41.340761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:41.367979 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c0e64-cf72-453f-bf5e-4794766a8ccc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:41.403283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d62a47-ebc6-4e1a-b157-7067a46291ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:41.403944 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62a47-ebc6-4e1a-b157-7067a46291ac None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:41.404274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62a47-ebc6-4e1a-b157-7067a46291ac None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:41.404548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62a47-ebc6-4e1a-b157-7067a46291ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:41.411086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d62a47-ebc6-4e1a-b157-7067a46291ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:41.412586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d62a47-ebc6-4e1a-b157-7067a46291ac None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-49d62a47-ebc6-4e1a-b157-7067a46291ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:22:41.424110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:41.425133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:41.426114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:22:41.426114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:22:41.426114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:22:41.426114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:22:41.426114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:22:41.426114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:22:41.426114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:41.426114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:41.426114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 628/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:22:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:22:41.431631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e85a1e-5546-4fe3-862f-973e58ed432e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:41.549359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e85a1e-5546-4fe3-862f-973e58ed432e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:41.588824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fb8c0-fa59-4474-896d-46278a688692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:41.589461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fb8c0-fa59-4474-896d-46278a688692 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:41.589731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fb8c0-fa59-4474-896d-46278a688692 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:41.589967 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fb8c0-fa59-4474-896d-46278a688692 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:41.590800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fb8c0-fa59-4474-896d-46278a688692 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:41.591137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fb8c0-fa59-4474-896d-46278a688692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:41.593060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fb8c0-fa59-4474-896d-46278a688692 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:41.607223 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 617/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:22:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:41.614422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d62a47-ebc6-4e1a-b157-7067a46291ac None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:41.721621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d62a47-ebc6-4e1a-b157-7067a46291ac None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:41.762396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2c780-9422-4c47-baaf-dbc35b46975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:41.763355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2c780-9422-4c47-baaf-dbc35b46975c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:41.764044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2c780-9422-4c47-baaf-dbc35b46975c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:41.764460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2c780-9422-4c47-baaf-dbc35b46975c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:41.765387 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2c780-9422-4c47-baaf-dbc35b46975c None admin] RBAC: Adding query filter params (role.id=b62720b095b548c38bc8740a29e49cb2, scope.project.id=e6bea894013f40638404395075ade90d, user.id=ff4e48fdc18e424fa2cf80fd5da332b6) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:41.765800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2c780-9422-4c47-baaf-dbc35b46975c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:41.768335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2c780-9422-4c47-baaf-dbc35b46975c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:41.775666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 629/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:22:41 2022] GET /identity/v3/role_assignments?user.id=ff4e48fdc18e424fa2cf80fd5da332b6&scope.project.id=e6bea894013f40638404395075ade90d&role.id=b62720b095b548c38bc8740a29e49cb2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:44.108579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6070b-288f-4659-b7fb-aa2feaf017e6 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:44.109247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6070b-288f-4659-b7fb-aa2feaf017e6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:44.109247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6070b-288f-4659-b7fb-aa2feaf017e6 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:44.110769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 618/1247] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:22:44.116795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb62d9c-0c88-4937-bd8c-64e14eae7d48 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:44.117414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb62d9c-0c88-4937-bd8c-64e14eae7d48 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:44.117414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb62d9c-0c88-4937-bd8c-64e14eae7d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:44.123929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:44.137672 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2bb62d9c-0c88-4937-bd8c-64e14eae7d48 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:22:44.139255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2bb62d9c-0c88-4937-bd8c-64e14eae7d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:22:44.213445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 630/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:22:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:22:44.473481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6070b-288f-4659-b7fb-aa2feaf017e6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:44.493943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:44.581633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6070b-288f-4659-b7fb-aa2feaf017e6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:44.617574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075205b-0357-436f-be89-c43a74464129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:44.618215 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075205b-0357-436f-be89-c43a74464129 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:44.618507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075205b-0357-436f-be89-c43a74464129 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:44.618760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075205b-0357-436f-be89-c43a74464129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:44.630091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075205b-0357-436f-be89-c43a74464129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-e075205b-0357-436f-be89-c43a74464129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:22:44.635024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:44.636165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:44.640462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 619/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:22:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:44.642766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb62d9c-0c88-4937-bd8c-64e14eae7d48 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:44.751275 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb62d9c-0c88-4937-bd8c-64e14eae7d48 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:44.780758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:44.786052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104070a-8abc-4215-8161-1e734b4d3c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:44.786689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104070a-8abc-4215-8161-1e734b4d3c0e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:44.787009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104070a-8abc-4215-8161-1e734b4d3c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:44.787211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104070a-8abc-4215-8161-1e734b4d3c0e None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:44.787954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104070a-8abc-4215-8161-1e734b4d3c0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:44.788255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104070a-8abc-4215-8161-1e734b4d3c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:44.789703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104070a-8abc-4215-8161-1e734b4d3c0e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:44.798337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 631/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:22:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:44.804756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075205b-0357-436f-be89-c43a74464129 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:44.883840 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:44.908000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075205b-0357-436f-be89-c43a74464129 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:44.947281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a898655-fe86-4c2e-ad44-1fe6c1e343f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:44.947939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898655-fe86-4c2e-ad44-1fe6c1e343f5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:44.948235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898655-fe86-4c2e-ad44-1fe6c1e343f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:44.948504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898655-fe86-4c2e-ad44-1fe6c1e343f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:44.961580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a898655-fe86-4c2e-ad44-1fe6c1e343f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:44.963326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a898655-fe86-4c2e-ad44-1fe6c1e343f5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4a898655-fe86-4c2e-ad44-1fe6c1e343f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:44.979811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:44.980968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:44.987004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:44.987004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:44.987004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:44.987004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 620/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:44.987293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104070a-8abc-4215-8161-1e734b4d3c0e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:45.097488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104070a-8abc-4215-8161-1e734b4d3c0e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:45.131942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18a1ec-6a56-49ce-907a-62d27443e1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:45.132638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18a1ec-6a56-49ce-907a-62d27443e1db None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:45.132827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18a1ec-6a56-49ce-907a-62d27443e1db None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:45.133098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18a1ec-6a56-49ce-907a-62d27443e1db None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:45.133798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18a1ec-6a56-49ce-907a-62d27443e1db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:45.134205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18a1ec-6a56-49ce-907a-62d27443e1db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:45.135650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18a1ec-6a56-49ce-907a-62d27443e1db None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:45.147589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 632/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:45.153906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a898655-fe86-4c2e-ad44-1fe6c1e343f5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:45.263066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a898655-fe86-4c2e-ad44-1fe6c1e343f5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:45.290793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:45.299075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040b89-09c3-413d-b3be-01ebb047f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:45.299750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040b89-09c3-413d-b3be-01ebb047f187 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:45.300026 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040b89-09c3-413d-b3be-01ebb047f187 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:45.300292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040b89-09c3-413d-b3be-01ebb047f187 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:45.308005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040b89-09c3-413d-b3be-01ebb047f187 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:45.309465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040b89-09c3-413d-b3be-01ebb047f187 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-be040b89-09c3-413d-b3be-01ebb047f187 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:22:45.321479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:45.327747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:45.329067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 621/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:22:45.329848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18a1ec-6a56-49ce-907a-62d27443e1db None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:45.397304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:45.442126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18a1ec-6a56-49ce-907a-62d27443e1db None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:45.484766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63114a-3568-4850-b875-570c8ac3a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:45.485377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63114a-3568-4850-b875-570c8ac3a389 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:45.485649 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63114a-3568-4850-b875-570c8ac3a389 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:45.485911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63114a-3568-4850-b875-570c8ac3a389 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:45.486639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63114a-3568-4850-b875-570c8ac3a389 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:45.486934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63114a-3568-4850-b875-570c8ac3a389 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:45.488389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63114a-3568-4850-b875-570c8ac3a389 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:45.507974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 633/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Oct 6 04:22:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:45.514551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040b89-09c3-413d-b3be-01ebb047f187 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:45.622237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040b89-09c3-413d-b3be-01ebb047f187 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:45.661624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2bb26-5046-452e-8370-951cd6cfbfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:45.662319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2bb26-5046-452e-8370-951cd6cfbfff None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:45.662576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2bb26-5046-452e-8370-951cd6cfbfff None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:45.662838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2bb26-5046-452e-8370-951cd6cfbfff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:45.723931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:45.736776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2bb26-5046-452e-8370-951cd6cfbfff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:45.738245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2bb26-5046-452e-8370-951cd6cfbfff None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:45.844945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 622/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:22:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:22:45.851258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63114a-3568-4850-b875-570c8ac3a389 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:45.979499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63114a-3568-4850-b875-570c8ac3a389 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:46.000205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:46.029565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee15848-97ef-4009-ae7e-79fa9cd5bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:46.030252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee15848-97ef-4009-ae7e-79fa9cd5bad1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:46.030527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee15848-97ef-4009-ae7e-79fa9cd5bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:46.030839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee15848-97ef-4009-ae7e-79fa9cd5bad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:46.043047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee15848-97ef-4009-ae7e-79fa9cd5bad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:46.044719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee15848-97ef-4009-ae7e-79fa9cd5bad1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8ee15848-97ef-4009-ae7e-79fa9cd5bad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:46.062548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:46.063809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:46.064957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:46.064957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:46.064957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:46.064957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 634/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:46.069994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2bb26-5046-452e-8370-951cd6cfbfff None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:46.168600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:46.182156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2bb26-5046-452e-8370-951cd6cfbfff None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:46.217900 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb51a-9ec0-451e-aac5-cf5a97d7d94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:46.218519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb51a-9ec0-451e-aac5-cf5a97d7d94a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:46.218792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb51a-9ec0-451e-aac5-cf5a97d7d94a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:46.219060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb51a-9ec0-451e-aac5-cf5a97d7d94a None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:46.219756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eb51a-9ec0-451e-aac5-cf5a97d7d94a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:46.220057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eb51a-9ec0-451e-aac5-cf5a97d7d94a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:46.221470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eb51a-9ec0-451e-aac5-cf5a97d7d94a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:46.234571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 623/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:46.241060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee15848-97ef-4009-ae7e-79fa9cd5bad1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:46.352365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee15848-97ef-4009-ae7e-79fa9cd5bad1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:46.390576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2d0ed-98c7-4fe9-85b0-360fcc73b857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:46.391232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2d0ed-98c7-4fe9-85b0-360fcc73b857 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:46.391536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2d0ed-98c7-4fe9-85b0-360fcc73b857 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:46.391802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2d0ed-98c7-4fe9-85b0-360fcc73b857 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:46.399293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2d0ed-98c7-4fe9-85b0-360fcc73b857 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:46.400814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2d0ed-98c7-4fe9-85b0-360fcc73b857 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f6c2d0ed-98c7-4fe9-85b0-360fcc73b857 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:22:46.413502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:46.414624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:46.416237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:22:46.416237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:22:46.416237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:22:46.416237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:22:46.416237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:22:46.416237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:22:46.416237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:46.416237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:46.416237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 635/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:22:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:46.420953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb51a-9ec0-451e-aac5-cf5a97d7d94a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:46.528160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb51a-9ec0-451e-aac5-cf5a97d7d94a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:46.561693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922230df-9357-490b-b66b-590d27bba1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:46.562479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922230df-9357-490b-b66b-590d27bba1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:46.562752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922230df-9357-490b-b66b-590d27bba1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:46.563002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922230df-9357-490b-b66b-590d27bba1d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:46.563754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922230df-9357-490b-b66b-590d27bba1d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:46.564053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922230df-9357-490b-b66b-590d27bba1d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:46.565484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922230df-9357-490b-b66b-590d27bba1d1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:46.577870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 624/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:22:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:46.584270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2d0ed-98c7-4fe9-85b0-360fcc73b857 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:46.611418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:46.685591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2d0ed-98c7-4fe9-85b0-360fcc73b857 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:46.718627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5ff16-da89-411a-a35b-19256353a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:46.719234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5ff16-da89-411a-a35b-19256353a481 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:46.719537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5ff16-da89-411a-a35b-19256353a481 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:46.719806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5ff16-da89-411a-a35b-19256353a481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:46.720524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5ff16-da89-411a-a35b-19256353a481 None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=e6bea894013f40638404395075ade90d, user.id=ff4e48fdc18e424fa2cf80fd5da332b6) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:46.720825 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5ff16-da89-411a-a35b-19256353a481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:46.722256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5ff16-da89-411a-a35b-19256353a481 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:46.727747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 636/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:22:46 2022] GET /identity/v3/role_assignments?user.id=ff4e48fdc18e424fa2cf80fd5da332b6&scope.project.id=e6bea894013f40638404395075ade90d&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:48.867350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638feb9-6141-4fcf-8c84-2b9c95623354 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:48.868223 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638feb9-6141-4fcf-8c84-2b9c95623354 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:48.868223 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638feb9-6141-4fcf-8c84-2b9c95623354 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:48.870321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 625/1261] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:22:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:22:48.876722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e9a8-fb77-4705-9ebc-4b1b06457282 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:48.877179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e9a8-fb77-4705-9ebc-4b1b06457282 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:48.877278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e9a8-fb77-4705-9ebc-4b1b06457282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:48.898862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-83b8e9a8-fb77-4705-9ebc-4b1b06457282 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:22:48.900045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-83b8e9a8-fb77-4705-9ebc-4b1b06457282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:22:48.967657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 637/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:22:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:22:49.265464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638feb9-6141-4fcf-8c84-2b9c95623354 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:49.277144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:49.383196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638feb9-6141-4fcf-8c84-2b9c95623354 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:49.417871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068276-4bb5-4f09-9e99-c6eb495dad5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:49.418484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068276-4bb5-4f09-9e99-c6eb495dad5c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:49.418752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068276-4bb5-4f09-9e99-c6eb495dad5c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:49.419012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068276-4bb5-4f09-9e99-c6eb495dad5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:49.429488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e068276-4bb5-4f09-9e99-c6eb495dad5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-2e068276-4bb5-4f09-9e99-c6eb495dad5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:22:49.434240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:49.435388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:49.436660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 626/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:22:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:49.442166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8e9a8-fb77-4705-9ebc-4b1b06457282 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:49.464194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:49.545616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8e9a8-fb77-4705-9ebc-4b1b06457282 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:49.583255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539debc-7d13-43a5-af75-caa37c2878e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:49.583887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539debc-7d13-43a5-af75-caa37c2878e8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:49.584160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539debc-7d13-43a5-af75-caa37c2878e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:49.584420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539debc-7d13-43a5-af75-caa37c2878e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:49.585112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539debc-7d13-43a5-af75-caa37c2878e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:49.585387 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539debc-7d13-43a5-af75-caa37c2878e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:49.586746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539debc-7d13-43a5-af75-caa37c2878e8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:49.595347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 638/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:22:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:49.603965 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068276-4bb5-4f09-9e99-c6eb495dad5c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:49.677348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:49.724648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068276-4bb5-4f09-9e99-c6eb495dad5c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:49.760992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6262490-046b-4381-879c-4b1c7740e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:49.761606 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6262490-046b-4381-879c-4b1c7740e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:49.761876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6262490-046b-4381-879c-4b1c7740e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:49.762140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6262490-046b-4381-879c-4b1c7740e1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:49.772744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6262490-046b-4381-879c-4b1c7740e1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:49.774194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6262490-046b-4381-879c-4b1c7740e1f2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b6262490-046b-4381-879c-4b1c7740e1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:49.789868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:49.791016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:49.792048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:49.792048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:49.792048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:49.792048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 627/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 04:22:49.799720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539debc-7d13-43a5-af75-caa37c2878e8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:49.888210 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:49.908594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539debc-7d13-43a5-af75-caa37c2878e8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:49.944416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962cf3e-378a-403b-a5e4-6d0778961894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:49.945005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962cf3e-378a-403b-a5e4-6d0778961894 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:49.945277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962cf3e-378a-403b-a5e4-6d0778961894 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:49.945539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962cf3e-378a-403b-a5e4-6d0778961894 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:49.946176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962cf3e-378a-403b-a5e4-6d0778961894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:49.946473 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962cf3e-378a-403b-a5e4-6d0778961894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:49.947864 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962cf3e-378a-403b-a5e4-6d0778961894 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:49.960559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 639/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:49.967047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6262490-046b-4381-879c-4b1c7740e1f2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:50.078805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6262490-046b-4381-879c-4b1c7740e1f2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:50.099041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:50.114087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28b386-026a-4347-b248-55a1a9b797e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:50.114712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28b386-026a-4347-b248-55a1a9b797e3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:50.114991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28b386-026a-4347-b248-55a1a9b797e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:50.115650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28b386-026a-4347-b248-55a1a9b797e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:50.123631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28b386-026a-4347-b248-55a1a9b797e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:50.125079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28b386-026a-4347-b248-55a1a9b797e3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6f28b386-026a-4347-b248-55a1a9b797e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:22:50.136434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:50.137488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:50.139105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 628/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:50.143791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962cf3e-378a-403b-a5e4-6d0778961894 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:50.249117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962cf3e-378a-403b-a5e4-6d0778961894 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:50.284372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2800-f4df-48e6-8858-bae47ef77c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:50.284970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2800-f4df-48e6-8858-bae47ef77c6c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:50.285247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2800-f4df-48e6-8858-bae47ef77c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:50.285504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2800-f4df-48e6-8858-bae47ef77c6c None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:50.286224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2800-f4df-48e6-8858-bae47ef77c6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:50.286527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2800-f4df-48e6-8858-bae47ef77c6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:50.287966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2800-f4df-48e6-8858-bae47ef77c6c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:50.297577 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:50.311534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 640/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Oct 6 04:22:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:50.319460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28b386-026a-4347-b248-55a1a9b797e3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:50.434055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28b386-026a-4347-b248-55a1a9b797e3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:50.468691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf609ce-05b4-4032-8795-08d7a1c1fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:50.469309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf609ce-05b4-4032-8795-08d7a1c1fb45 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:50.469580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf609ce-05b4-4032-8795-08d7a1c1fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:50.469845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf609ce-05b4-4032-8795-08d7a1c1fb45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:50.480808 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf609ce-05b4-4032-8795-08d7a1c1fb45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:50.482308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf609ce-05b4-4032-8795-08d7a1c1fb45 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1bf609ce-05b4-4032-8795-08d7a1c1fb45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:50.498008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:50.499063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:50.500186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:50.500186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:50.500186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:50.500186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 629/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:50.505221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2800-f4df-48e6-8858-bae47ef77c6c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:50.620975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2800-f4df-48e6-8858-bae47ef77c6c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:50.657019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c55be-61ff-4bab-8b43-7ac16c7c7988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:50.657619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c55be-61ff-4bab-8b43-7ac16c7c7988 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:50.657890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c55be-61ff-4bab-8b43-7ac16c7c7988 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:50.658151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c55be-61ff-4bab-8b43-7ac16c7c7988 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:50.658796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c55be-61ff-4bab-8b43-7ac16c7c7988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:50.659096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c55be-61ff-4bab-8b43-7ac16c7c7988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:50.660516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c55be-61ff-4bab-8b43-7ac16c7c7988 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:50.673393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 641/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:50.679958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf609ce-05b4-4032-8795-08d7a1c1fb45 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:50.715224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:50.787291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf609ce-05b4-4032-8795-08d7a1c1fb45 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:50.822053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced7659-872d-4af2-9f5c-ae5c52215edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:50.822661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced7659-872d-4af2-9f5c-ae5c52215edb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:50.822932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced7659-872d-4af2-9f5c-ae5c52215edb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:50.823201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced7659-872d-4af2-9f5c-ae5c52215edb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:50.830181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced7659-872d-4af2-9f5c-ae5c52215edb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:50.831656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced7659-872d-4af2-9f5c-ae5c52215edb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6ced7659-872d-4af2-9f5c-ae5c52215edb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:22:50.843547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:50.844588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:50.845545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:22:50.845545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:22:50.845545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:22:50.845545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:22:50.845545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:22:50.845545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:22:50.845545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:50.845545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:50.845545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 630/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:50.851293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c55be-61ff-4bab-8b43-7ac16c7c7988 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:50.916327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:50.961870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c55be-61ff-4bab-8b43-7ac16c7c7988 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:51.001281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c046d-2c6c-4292-b0c6-804060746d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:51.001814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c046d-2c6c-4292-b0c6-804060746d6c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:51.002084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c046d-2c6c-4292-b0c6-804060746d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:51.002349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c046d-2c6c-4292-b0c6-804060746d6c None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:51.003039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c046d-2c6c-4292-b0c6-804060746d6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:51.003355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c046d-2c6c-4292-b0c6-804060746d6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:51.004805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c046d-2c6c-4292-b0c6-804060746d6c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:51.017500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 642/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:51.023793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced7659-872d-4af2-9f5c-ae5c52215edb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:51.127266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:51.138177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced7659-872d-4af2-9f5c-ae5c52215edb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:51.176992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58151ab-1b6b-4a5d-b626-4fed7e804e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:51.177935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58151ab-1b6b-4a5d-b626-4fed7e804e58 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:51.178293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58151ab-1b6b-4a5d-b626-4fed7e804e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:51.178622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58151ab-1b6b-4a5d-b626-4fed7e804e58 None admin] PATH_INFO: `/v3/projects/e6bea894013f40638404395075ade90d/users/ff4e48fdc18e424fa2cf80fd5da332b6/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:51.182147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58151ab-1b6b-4a5d-b626-4fed7e804e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6bea894013f40638404395075ade90d, user_id=ff4e48fdc18e424fa2cf80fd5da332b6, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:51.184470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58151ab-1b6b-4a5d-b626-4fed7e804e58 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:51.204254 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 631/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Oct 6 04:22:51 2022] PUT /identity/v3/projects/e6bea894013f40638404395075ade90d/users/ff4e48fdc18e424fa2cf80fd5da332b6/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:22:53.304466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74564f-cce7-4c81-ad6e-e1ae43fc5938 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:53.305056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74564f-cce7-4c81-ad6e-e1ae43fc5938 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:53.305056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74564f-cce7-4c81-ad6e-e1ae43fc5938 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:53.306372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 643/1274] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:22:53.315170 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce6829-c57b-4bf7-a037-8b7f7a8c5986 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:53.315906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce6829-c57b-4bf7-a037-8b7f7a8c5986 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:53.316047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce6829-c57b-4bf7-a037-8b7f7a8c5986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:53.338210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-05ce6829-c57b-4bf7-a037-8b7f7a8c5986 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:22:53.339479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-05ce6829-c57b-4bf7-a037-8b7f7a8c5986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:22:53.411156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 632/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:22:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:22:53.678593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74564f-cce7-4c81-ad6e-e1ae43fc5938 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:53.784643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74564f-cce7-4c81-ad6e-e1ae43fc5938 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:53.801838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:53.822768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690fe07-a9b8-429e-a067-549f76f5aec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:53.823428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690fe07-a9b8-429e-a067-549f76f5aec5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:53.823704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690fe07-a9b8-429e-a067-549f76f5aec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:53.823969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690fe07-a9b8-429e-a067-549f76f5aec5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:53.835748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690fe07-a9b8-429e-a067-549f76f5aec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7690fe07-a9b8-429e-a067-549f76f5aec5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 04:22:53.840537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:53.841653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:53.843054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 644/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Oct 6 04:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:53.851578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce6829-c57b-4bf7-a037-8b7f7a8c5986 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:53.946758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:53.969351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce6829-c57b-4bf7-a037-8b7f7a8c5986 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:54.009097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249966c0-0fc8-4ca4-9f11-bff8d5207de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:54.009875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249966c0-0fc8-4ca4-9f11-bff8d5207de1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:54.010147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249966c0-0fc8-4ca4-9f11-bff8d5207de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:54.010417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249966c0-0fc8-4ca4-9f11-bff8d5207de1 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:54.011184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249966c0-0fc8-4ca4-9f11-bff8d5207de1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:54.011518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249966c0-0fc8-4ca4-9f11-bff8d5207de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:54.013203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249966c0-0fc8-4ca4-9f11-bff8d5207de1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:54.022305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 633/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Oct 6 04:22:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:54.028545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690fe07-a9b8-429e-a067-549f76f5aec5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:54.128407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690fe07-a9b8-429e-a067-549f76f5aec5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:54.163663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18a3fc-736d-40ba-b291-b849c629dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:54.164287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18a3fc-736d-40ba-b291-b849c629dce8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:54.164567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18a3fc-736d-40ba-b291-b849c629dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:54.164826 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18a3fc-736d-40ba-b291-b849c629dce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:54.175179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18a3fc-736d-40ba-b291-b849c629dce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:54.176649 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18a3fc-736d-40ba-b291-b849c629dce8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6e18a3fc-736d-40ba-b291-b849c629dce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:54.191330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:54.192370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:54.193315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:54.193315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:54.193315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:54.193315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 645/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:54.198644 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249966c0-0fc8-4ca4-9f11-bff8d5207de1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:54.310050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249966c0-0fc8-4ca4-9f11-bff8d5207de1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:54.347083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc6b4c-3ab4-46a5-8129-af9fbb9ad291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:54.347722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc6b4c-3ab4-46a5-8129-af9fbb9ad291 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:54.347961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc6b4c-3ab4-46a5-8129-af9fbb9ad291 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:54.348226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc6b4c-3ab4-46a5-8129-af9fbb9ad291 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:54.348859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc6b4c-3ab4-46a5-8129-af9fbb9ad291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:54.349147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc6b4c-3ab4-46a5-8129-af9fbb9ad291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:54.350521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc6b4c-3ab4-46a5-8129-af9fbb9ad291 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:54.362333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 634/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:54.369154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18a3fc-736d-40ba-b291-b849c629dce8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:54.404611 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:54.478705 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18a3fc-736d-40ba-b291-b849c629dce8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:54.513197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc98df0-cf29-4293-8ca8-d38264a1d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:54.513863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc98df0-cf29-4293-8ca8-d38264a1d09f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:54.514136 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc98df0-cf29-4293-8ca8-d38264a1d09f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:54.514402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc98df0-cf29-4293-8ca8-d38264a1d09f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:54.522570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc98df0-cf29-4293-8ca8-d38264a1d09f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:54.524040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc98df0-cf29-4293-8ca8-d38264a1d09f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7fc98df0-cf29-4293-8ca8-d38264a1d09f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 04:22:54.535729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:54.536804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:54.538537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 646/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:54.546318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc6b4c-3ab4-46a5-8129-af9fbb9ad291 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:54.552598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:54.653438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc6b4c-3ab4-46a5-8129-af9fbb9ad291 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:54.692052 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56191e51-adb0-4102-91e3-d4eac7df9451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:54.692653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191e51-adb0-4102-91e3-d4eac7df9451 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:54.692928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191e51-adb0-4102-91e3-d4eac7df9451 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:54.693191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191e51-adb0-4102-91e3-d4eac7df9451 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:54.693919 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56191e51-adb0-4102-91e3-d4eac7df9451 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:54.694221 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56191e51-adb0-4102-91e3-d4eac7df9451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:54.695679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56191e51-adb0-4102-91e3-d4eac7df9451 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:54.713448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 635/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Oct 6 04:22:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:54.719617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc98df0-cf29-4293-8ca8-d38264a1d09f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:54.822779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:54.836530 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc98df0-cf29-4293-8ca8-d38264a1d09f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:54.879861 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6af0ca-c50f-4a99-9577-acb6d6b7c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:54.880453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6af0ca-c50f-4a99-9577-acb6d6b7c669 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:54.880730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6af0ca-c50f-4a99-9577-acb6d6b7c669 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:54.881000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6af0ca-c50f-4a99-9577-acb6d6b7c669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:54.953337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6af0ca-c50f-4a99-9577-acb6d6b7c669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:54.954774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6af0ca-c50f-4a99-9577-acb6d6b7c669 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:55.046738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:55.057267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 647/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Oct 6 04:22:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 04:22:55.065298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56191e51-adb0-4102-91e3-d4eac7df9451 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:55.142968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:55.183458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56191e51-adb0-4102-91e3-d4eac7df9451 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:55.220827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca57039-dadc-4ce3-a0eb-7b9a1922996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:55.221438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca57039-dadc-4ce3-a0eb-7b9a1922996e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:55.221709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca57039-dadc-4ce3-a0eb-7b9a1922996e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:55.221972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca57039-dadc-4ce3-a0eb-7b9a1922996e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:55.233224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca57039-dadc-4ce3-a0eb-7b9a1922996e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:55.234662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca57039-dadc-4ce3-a0eb-7b9a1922996e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1ca57039-dadc-4ce3-a0eb-7b9a1922996e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 04:22:55.249537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:55.250619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 04:22:55.251890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 04:22:55.251890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 04:22:55.251890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:55.251890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 636/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:55.257150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6af0ca-c50f-4a99-9577-acb6d6b7c669 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:55.369407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6af0ca-c50f-4a99-9577-acb6d6b7c669 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:55.405072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b2c00-e532-4ae7-89fb-abdf3249271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:55.405606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b2c00-e532-4ae7-89fb-abdf3249271d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:55.405884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b2c00-e532-4ae7-89fb-abdf3249271d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:55.406157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b2c00-e532-4ae7-89fb-abdf3249271d None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:55.406801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b2c00-e532-4ae7-89fb-abdf3249271d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:55.407103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b2c00-e532-4ae7-89fb-abdf3249271d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:55.408514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b2c00-e532-4ae7-89fb-abdf3249271d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:55.419833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 648/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Oct 6 04:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:55.429123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca57039-dadc-4ce3-a0eb-7b9a1922996e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:55.550008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca57039-dadc-4ce3-a0eb-7b9a1922996e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:55.568578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:55.592336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141212c-dfa3-4448-818d-d32a31fa168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:55.592955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141212c-dfa3-4448-818d-d32a31fa168e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:55.593233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141212c-dfa3-4448-818d-d32a31fa168e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:55.593505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141212c-dfa3-4448-818d-d32a31fa168e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:55.600469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141212c-dfa3-4448-818d-d32a31fa168e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:55.602818 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141212c-dfa3-4448-818d-d32a31fa168e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c141212c-dfa3-4448-818d-d32a31fa168e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 04:22:55.616384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:55.617369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:55.618656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 04:22:55.618656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 04:22:55.618656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 04:22:55.618656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 04:22:55.618656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 04:22:55.618656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 04:22:55.618656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 04:22:55.618656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Oct 06 04:22:55.618656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 637/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Oct 6 04:22:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:55.626528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b2c00-e532-4ae7-89fb-abdf3249271d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:55.687183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:55.742602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b2c00-e532-4ae7-89fb-abdf3249271d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:55.780338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7b569-5866-499f-8234-b85f7d438d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:55.780943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b569-5866-499f-8234-b85f7d438d53 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:55.781215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b569-5866-499f-8234-b85f7d438d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:55.781478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b569-5866-499f-8234-b85f7d438d53 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:55.782162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7b569-5866-499f-8234-b85f7d438d53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:55.782461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7b569-5866-499f-8234-b85f7d438d53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:55.784019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7b569-5866-499f-8234-b85f7d438d53 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:55.796464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 649/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Oct 6 04:22:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:55.802951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141212c-dfa3-4448-818d-d32a31fa168e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:55.911810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141212c-dfa3-4448-818d-d32a31fa168e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:55.947022 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb1e96-c50d-46f4-8629-c68525c208cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:55.947567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb1e96-c50d-46f4-8629-c68525c208cc None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:55.947836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb1e96-c50d-46f4-8629-c68525c208cc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:55.948100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb1e96-c50d-46f4-8629-c68525c208cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:55.948826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb1e96-c50d-46f4-8629-c68525c208cc None admin] RBAC: Adding query filter params (role.id=89425e36538543d89d2c3844c8b6dc0a, scope.project.id=e6bea894013f40638404395075ade90d, user.id=ff4e48fdc18e424fa2cf80fd5da332b6) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:55.949127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb1e96-c50d-46f4-8629-c68525c208cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:55.950546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb1e96-c50d-46f4-8629-c68525c208cc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:55.956401 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 638/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Oct 6 04:22:55 2022] GET /identity/v3/role_assignments?user.id=ff4e48fdc18e424fa2cf80fd5da332b6&scope.project.id=e6bea894013f40638404395075ade90d&role.id=89425e36538543d89d2c3844c8b6dc0a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:58.104471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e054b1-a4e7-4e3b-9190-212a042144b9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:58.105385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e054b1-a4e7-4e3b-9190-212a042144b9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:58.105385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e054b1-a4e7-4e3b-9190-212a042144b9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:58.108037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 650/1288] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:22:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:22:58.113594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92a252-9f1f-495e-ba6b-8b5a0312ba5c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:58.114039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92a252-9f1f-495e-ba6b-8b5a0312ba5c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:58.114148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92a252-9f1f-495e-ba6b-8b5a0312ba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:58.133593 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-af92a252-9f1f-495e-ba6b-8b5a0312ba5c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:22:58.134767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-af92a252-9f1f-495e-ba6b-8b5a0312ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:22:58.164885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:58.204312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 639/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:22:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:22:58.480083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e054b1-a4e7-4e3b-9190-212a042144b9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:58.604206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e054b1-a4e7-4e3b-9190-212a042144b9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:58.616012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:22:58.643945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb3099-096c-4b15-9e0d-0697046b3f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:58.644564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb3099-096c-4b15-9e0d-0697046b3f9f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:58.644836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb3099-096c-4b15-9e0d-0697046b3f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:58.645099 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb3099-096c-4b15-9e0d-0697046b3f9f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:58.645674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb3099-096c-4b15-9e0d-0697046b3f9f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:58.647077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb3099-096c-4b15-9e0d-0697046b3f9f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d1bb3099-096c-4b15-9e0d-0697046b3f9f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:22:58.656306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:22:58.657474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:22:58.658447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 651/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 6 04:22:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:22:58.663815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92a252-9f1f-495e-ba6b-8b5a0312ba5c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:58.764102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92a252-9f1f-495e-ba6b-8b5a0312ba5c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:58.803960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f2dad-bdd6-49ff-825b-e3811de11af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:58.804565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f2dad-bdd6-49ff-825b-e3811de11af9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:58.804834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f2dad-bdd6-49ff-825b-e3811de11af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:58.805079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f2dad-bdd6-49ff-825b-e3811de11af9 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:58.805698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f2dad-bdd6-49ff-825b-e3811de11af9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:58.805993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f2dad-bdd6-49ff-825b-e3811de11af9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:58.807437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f2dad-bdd6-49ff-825b-e3811de11af9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:58.812838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 640/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Oct 6 04:22:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:22:58.822130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb3099-096c-4b15-9e0d-0697046b3f9f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:22:58.944952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb3099-096c-4b15-9e0d-0697046b3f9f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:22:58.982044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2c204-3b3e-4be9-b8b2-52a808f848cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:22:58.982906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c204-3b3e-4be9-b8b2-52a808f848cc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:22:58.983200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c204-3b3e-4be9-b8b2-52a808f848cc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:22:58.983532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c204-3b3e-4be9-b8b2-52a808f848cc None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:22:58.984161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2c204-3b3e-4be9-b8b2-52a808f848cc None admin] RBAC: Adding query filter params (type=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:22:58.984475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2c204-3b3e-4be9-b8b2-52a808f848cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:22:58.986313 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2c204-3b3e-4be9-b8b2-52a808f848cc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:22:58.992486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 652/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Oct 6 04:22:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:23:01.097616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd633-d388-4626-bdcb-8e0211257b44 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:01.098478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd633-d388-4626-bdcb-8e0211257b44 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:01.098478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd633-d388-4626-bdcb-8e0211257b44 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:01.100662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 641/1293] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:23:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:23:01.107052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505e6c2-0855-441a-8a4c-5bea3521dbae None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:01.107517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505e6c2-0855-441a-8a4c-5bea3521dbae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:01.107626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505e6c2-0855-441a-8a4c-5bea3521dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:01.128186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a505e6c2-0855-441a-8a4c-5bea3521dbae None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:23:01.129397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a505e6c2-0855-441a-8a4c-5bea3521dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:23:01.164052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:23:01.203773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 653/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:23:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:23:01.482414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfd633-d388-4626-bdcb-8e0211257b44 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:23:01.521681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:23:01.596791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfd633-d388-4626-bdcb-8e0211257b44 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:23:01.634219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664042b-8b06-4589-a1de-81c499a50216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:23:01.634811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664042b-8b06-4589-a1de-81c499a50216 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:01.635083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664042b-8b06-4589-a1de-81c499a50216 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:01.635345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664042b-8b06-4589-a1de-81c499a50216 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:01.636079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664042b-8b06-4589-a1de-81c499a50216 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:23:01.637437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664042b-8b06-4589-a1de-81c499a50216 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:23:01.655475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 642/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Oct 6 04:23:01 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:23:03.832913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd60872-d05a-42d3-8ad6-924e5c00fe9d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:03.833528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd60872-d05a-42d3-8ad6-924e5c00fe9d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:03.833528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd60872-d05a-42d3-8ad6-924e5c00fe9d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:03.834787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 654/1296] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:23:03.841346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e99dbc-71c8-4e79-bb0e-99c65b13b5f6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:03.841814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e99dbc-71c8-4e79-bb0e-99c65b13b5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:03.841922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e99dbc-71c8-4e79-bb0e-99c65b13b5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:03.862490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f4e99dbc-71c8-4e79-bb0e-99c65b13b5f6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:23:03.863699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f4e99dbc-71c8-4e79-bb0e-99c65b13b5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:23:03.942156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 643/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:23:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:23:04.230234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd60872-d05a-42d3-8ad6-924e5c00fe9d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:23:04.345219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd60872-d05a-42d3-8ad6-924e5c00fe9d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:23:04.381417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7299c9c-ab7e-421c-b427-c1c3a1dd50e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:23:04.382038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7299c9c-ab7e-421c-b427-c1c3a1dd50e6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:04.382306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7299c9c-ab7e-421c-b427-c1c3a1dd50e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:04.382569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7299c9c-ab7e-421c-b427-c1c3a1dd50e6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:04.383143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7299c9c-ab7e-421c-b427-c1c3a1dd50e6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:23:04.384569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7299c9c-ab7e-421c-b427-c1c3a1dd50e6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c7299c9c-ab7e-421c-b427-c1c3a1dd50e6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:23:04.393827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:23:04.394967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:23:04.395865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 655/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 6 04:23:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:23:04.401768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e99dbc-71c8-4e79-bb0e-99c65b13b5f6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:23:04.421801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:23:04.511131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e99dbc-71c8-4e79-bb0e-99c65b13b5f6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:23:04.549375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24e72-9227-4158-821e-bc7dc8f456b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:23:04.550230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24e72-9227-4158-821e-bc7dc8f456b4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:04.550600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24e72-9227-4158-821e-bc7dc8f456b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:04.550945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24e72-9227-4158-821e-bc7dc8f456b4 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:04.551925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f24e72-9227-4158-821e-bc7dc8f456b4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:23:04.552321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f24e72-9227-4158-821e-bc7dc8f456b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:23:04.554485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f24e72-9227-4158-821e-bc7dc8f456b4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:23:04.562322 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 644/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Oct 6 04:23:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:23:04.571185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7299c9c-ab7e-421c-b427-c1c3a1dd50e6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:23:04.603996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:23:04.676831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7299c9c-ab7e-421c-b427-c1c3a1dd50e6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:23:04.710928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d60bd6-50f3-4b43-80bc-141b9ff575e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:23:04.711551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d60bd6-50f3-4b43-80bc-141b9ff575e9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:04.711825 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d60bd6-50f3-4b43-80bc-141b9ff575e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:04.712096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d60bd6-50f3-4b43-80bc-141b9ff575e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:04.712796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d60bd6-50f3-4b43-80bc-141b9ff575e9 None admin] RBAC: Adding query filter params (interface=public, service_id=07510d0652464ee8abcb5efc9ed9e2eb, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:23:04.713101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d60bd6-50f3-4b43-80bc-141b9ff575e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:23:04.714467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d60bd6-50f3-4b43-80bc-141b9ff575e9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:23:04.719687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 656/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Oct 6 04:23:04 2022] GET /identity/v3/endpoints?service_id=07510d0652464ee8abcb5efc9ed9e2eb&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:23:04.726344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24e72-9227-4158-821e-bc7dc8f456b4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:23:04.818608 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:23:04.842049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24e72-9227-4158-821e-bc7dc8f456b4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:23:04.878200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3440774-4d6f-4477-92e6-3e47566a82e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:23:04.878795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440774-4d6f-4477-92e6-3e47566a82e5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:04.879067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440774-4d6f-4477-92e6-3e47566a82e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:04.879348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440774-4d6f-4477-92e6-3e47566a82e5 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:04.879945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3440774-4d6f-4477-92e6-3e47566a82e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:23:04.881315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3440774-4d6f-4477-92e6-3e47566a82e5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:23:04.888201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 645/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Oct 6 04:23:04 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:23:06.989470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0beed-25aa-4e15-b4a5-67fe68d703fc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:06.990690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0beed-25aa-4e15-b4a5-67fe68d703fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:06.990690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0beed-25aa-4e15-b4a5-67fe68d703fc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:06.992895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 657/1302] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:23:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:23:06.998343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3537bd-7bf8-4bcc-8aa0-e5785d366a61 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:06.998786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3537bd-7bf8-4bcc-8aa0-e5785d366a61 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:06.998885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3537bd-7bf8-4bcc-8aa0-e5785d366a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:07.017776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0b3537bd-7bf8-4bcc-8aa0-e5785d366a61 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:23:07.018943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0b3537bd-7bf8-4bcc-8aa0-e5785d366a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:23:07.098570 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 646/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:23:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 04:23:07.362107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0beed-25aa-4e15-b4a5-67fe68d703fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:23:07.468132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:23:07.475902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0beed-25aa-4e15-b4a5-67fe68d703fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:23:07.512240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f91240-6c37-4ba1-81c7-f593ee32f993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:23:07.512855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f91240-6c37-4ba1-81c7-f593ee32f993 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:07.513158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f91240-6c37-4ba1-81c7-f593ee32f993 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:07.513421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f91240-6c37-4ba1-81c7-f593ee32f993 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:07.513994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f91240-6c37-4ba1-81c7-f593ee32f993 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:23:07.515348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f91240-6c37-4ba1-81c7-f593ee32f993 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-78f91240-6c37-4ba1-81c7-f593ee32f993 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 04:23:07.524789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 04:23:07.526000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Oct 06 04:23:07.527395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 658/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Oct 6 04:23:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 04:23:07.532954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3537bd-7bf8-4bcc-8aa0-e5785d366a61 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:23:07.606224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:23:07.632583 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3537bd-7bf8-4bcc-8aa0-e5785d366a61 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:23:07.668689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f4aea-e89d-4ce2-9759-9100d064ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:23:07.669311 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f4aea-e89d-4ce2-9759-9100d064ee3c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:07.669553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f4aea-e89d-4ce2-9759-9100d064ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:07.669841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f4aea-e89d-4ce2-9759-9100d064ee3c None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:07.670458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f4aea-e89d-4ce2-9759-9100d064ee3c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:23:07.670750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f4aea-e89d-4ce2-9759-9100d064ee3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:23:07.672228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f4aea-e89d-4ce2-9759-9100d064ee3c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:23:07.677749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 647/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Oct 6 04:23:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:23:07.683927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f91240-6c37-4ba1-81c7-f593ee32f993 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:23:07.788725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f91240-6c37-4ba1-81c7-f593ee32f993 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:23:07.823632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41fc39-d99d-4d10-96d7-e34762ea1c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:23:07.824390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41fc39-d99d-4d10-96d7-e34762ea1c75 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:23:07.825573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41fc39-d99d-4d10-96d7-e34762ea1c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:23:07.825573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41fc39-d99d-4d10-96d7-e34762ea1c75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:23:07.825573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41fc39-d99d-4d10-96d7-e34762ea1c75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:23:07.828125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41fc39-d99d-4d10-96d7-e34762ea1c75 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:23:07.848733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 659/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:23:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:23:17.674565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=30 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:23:17.844207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:12.079837 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a053e-6ac9-47e3-9134-9a993df35c7e None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:12.080369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a053e-6ac9-47e3-9134-9a993df35c7e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:12.080369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a053e-6ac9-47e3-9134-9a993df35c7e None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:12.085710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 648/1307] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:12.087096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53d2c1-d694-4a84-8dbb-4293fe92d56b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:12.087543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53d2c1-d694-4a84-8dbb-4293fe92d56b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:12.087839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53d2c1-d694-4a84-8dbb-4293fe92d56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:12.271190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5c53d2c1-d694-4a84-8dbb-4293fe92d56b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:12.272613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5c53d2c1-d694-4a84-8dbb-4293fe92d56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:12.419440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 660/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:24:12.706459 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e254e-ae15-4046-be8b-42d09982e206 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:12.707088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e254e-ae15-4046-be8b-42d09982e206 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:12.707804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e254e-ae15-4046-be8b-42d09982e206 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:12.709658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 649/1309] 10.222.0.20 () {54 vars in 964 bytes} [Thu Oct 6 04:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:12.715368 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421255fa-cbf3-4a31-b308-c748053ff079 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:12.716097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421255fa-cbf3-4a31-b308-c748053ff079 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:12.716586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421255fa-cbf3-4a31-b308-c748053ff079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:12.808694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-421255fa-cbf3-4a31-b308-c748053ff079 None None] MFA Rules not processed for user `39ca0a824c4740dbb911bb1a38cfc47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:12.810625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-421255fa-cbf3-4a31-b308-c748053ff079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:12.835486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:12.916943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 661/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Oct 6 04:24:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:12.925559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e254e-ae15-4046-be8b-42d09982e206 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:12.927751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c58e254e-ae15-4046-be8b-42d09982e206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:13.057151 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e254e-ae15-4046-be8b-42d09982e206 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:13.138167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cdb39-3164-4463-ba0e-56f057b3b27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:13.138887 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cdb39-3164-4463-ba0e-56f057b3b27e service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:13.139450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cdb39-3164-4463-ba0e-56f057b3b27e service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:13.139897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cdb39-3164-4463-ba0e-56f057b3b27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:13.141692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ab4cdb39-3164-4463-ba0e-56f057b3b27e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:13.197717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:13.257737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cdb39-3164-4463-ba0e-56f057b3b27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:13.259658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cdb39-3164-4463-ba0e-56f057b3b27e service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:13.282629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 650/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:15.725251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adf10-b57b-41e6-b3e5-5ab2bd342ae8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:15.725782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adf10-b57b-41e6-b3e5-5ab2bd342ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:15.725782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adf10-b57b-41e6-b3e5-5ab2bd342ae8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:15.727980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 662/1312] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:15.736687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf41cf-7b50-4e61-acfc-525328a848b8 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:15.737136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf41cf-7b50-4e61-acfc-525328a848b8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:15.737237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf41cf-7b50-4e61-acfc-525328a848b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:15.812177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c4cf41cf-7b50-4e61-acfc-525328a848b8 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:15.813382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c4cf41cf-7b50-4e61-acfc-525328a848b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:15.916404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 651/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:16.199056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165adf10-b57b-41e6-b3e5-5ab2bd342ae8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:16.200699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-165adf10-b57b-41e6-b3e5-5ab2bd342ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:16.307259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165adf10-b57b-41e6-b3e5-5ab2bd342ae8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:16.383771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:16.386065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2744e-a167-46a7-8b3c-de56a60270e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:16.386604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2744e-a167-46a7-8b3c-de56a60270e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:16.386866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2744e-a167-46a7-8b3c-de56a60270e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:16.387107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2744e-a167-46a7-8b3c-de56a60270e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:16.389341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1bf2744e-a167-46a7-8b3c-de56a60270e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:16.502713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2744e-a167-46a7-8b3c-de56a60270e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:16.504173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2744e-a167-46a7-8b3c-de56a60270e3 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:16.522704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 663/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:18.941940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b095076-8d74-4202-bef1-123c414f3ce4 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:18.942866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b095076-8d74-4202-bef1-123c414f3ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:18.942866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b095076-8d74-4202-bef1-123c414f3ce4 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:18.945089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 652/1315] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:18.951615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5190f-1b3b-452d-8efe-27147738a754 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:18.952050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5190f-1b3b-452d-8efe-27147738a754 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:18.952167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5190f-1b3b-452d-8efe-27147738a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:19.030206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a6a5190f-1b3b-452d-8efe-27147738a754 None None] MFA Rules not processed for user `f7676517cf3c47a0a7ed6087713bb3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:19.031449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a6a5190f-1b3b-452d-8efe-27147738a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:19.085049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:19.138187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 664/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:19.430771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b095076-8d74-4202-bef1-123c414f3ce4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:19.432382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6b095076-8d74-4202-bef1-123c414f3ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:19.443193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:19.542235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b095076-8d74-4202-bef1-123c414f3ce4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:19.626408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8158f02-cd57-47f0-afca-1e5a6beefebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:19.627016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158f02-cd57-47f0-afca-1e5a6beefebf service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:19.627288 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158f02-cd57-47f0-afca-1e5a6beefebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:19.627579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158f02-cd57-47f0-afca-1e5a6beefebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:19.629159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c8158f02-cd57-47f0-afca-1e5a6beefebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:19.697262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:19.745860 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8158f02-cd57-47f0-afca-1e5a6beefebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:19.747768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8158f02-cd57-47f0-afca-1e5a6beefebf service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:19.769707 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 653/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:22.439845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4846714-5be4-4035-a11a-e8369a6a6c5c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:22.440446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4846714-5be4-4035-a11a-e8369a6a6c5c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:22.440446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4846714-5be4-4035-a11a-e8369a6a6c5c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:22.441729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 665/1318] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:22.448138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3c7d-8c5a-4067-85a9-74d83805b0ca None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:22.448845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3c7d-8c5a-4067-85a9-74d83805b0ca None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:22.449039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3c7d-8c5a-4067-85a9-74d83805b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:22.525792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-267b3c7d-8c5a-4067-85a9-74d83805b0ca None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:22.527000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-267b3c7d-8c5a-4067-85a9-74d83805b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:22.635739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 654/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:22.939758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e4e79-1aa1-40fa-9a64-789a3c0dc102 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:22.940012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e4e79-1aa1-40fa-9a64-789a3c0dc102 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:22.940292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e4e79-1aa1-40fa-9a64-789a3c0dc102 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:22.941648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 666/1320] 10.222.0.20 () {54 vars in 964 bytes} [Thu Oct 6 04:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:22.948614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4947c8-5b9b-4c2e-be89-4d625035bf2a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:22.949089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4947c8-5b9b-4c2e-be89-4d625035bf2a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:22.949466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4947c8-5b9b-4c2e-be89-4d625035bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:22.974947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:23.039665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5d4947c8-5b9b-4c2e-be89-4d625035bf2a None None] MFA Rules not processed for user `39ca0a824c4740dbb911bb1a38cfc47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:23.040881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5d4947c8-5b9b-4c2e-be89-4d625035bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:23.121058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 655/1321] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Oct 6 04:24:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:23.130403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e4e79-1aa1-40fa-9a64-789a3c0dc102 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:23.131981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f66e4e79-1aa1-40fa-9a64-789a3c0dc102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:23.236642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e4e79-1aa1-40fa-9a64-789a3c0dc102 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:23.313249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71b090-ca6f-4a5f-a152-8402ff5f5c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:23.313859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b090-ca6f-4a5f-a152-8402ff5f5c6d service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:23.314139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b090-ca6f-4a5f-a152-8402ff5f5c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:23.314382 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b090-ca6f-4a5f-a152-8402ff5f5c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:23.316039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6b71b090-ca6f-4a5f-a152-8402ff5f5c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:23.323185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:23.429293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71b090-ca6f-4a5f-a152-8402ff5f5c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:23.430740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71b090-ca6f-4a5f-a152-8402ff5f5c6d service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:23.449813 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 667/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:26.725905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17375fef-c0d6-4cb7-8cdd-7f3fbd3f9b8c None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:26.726466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17375fef-c0d6-4cb7-8cdd-7f3fbd3f9b8c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:26.726466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17375fef-c0d6-4cb7-8cdd-7f3fbd3f9b8c None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:26.727833 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 656/1323] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:26.733329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b60020-116b-48c3-99a1-1b4b61cdd85d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:26.733779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b60020-116b-48c3-99a1-1b4b61cdd85d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:26.733976 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b60020-116b-48c3-99a1-1b4b61cdd85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:26.812605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e2b60020-116b-48c3-99a1-1b4b61cdd85d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:26.814049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e2b60020-116b-48c3-99a1-1b4b61cdd85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:26.883188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:26.928180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 668/1324] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:27.216625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17375fef-c0d6-4cb7-8cdd-7f3fbd3f9b8c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:27.218173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-17375fef-c0d6-4cb7-8cdd-7f3fbd3f9b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:27.344662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17375fef-c0d6-4cb7-8cdd-7f3fbd3f9b8c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:27.358011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:27.426571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82eaf5-5529-42cd-a4bb-d4ecb0e642fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:27.427229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82eaf5-5529-42cd-a4bb-d4ecb0e642fd service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:27.427581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82eaf5-5529-42cd-a4bb-d4ecb0e642fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:27.427850 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82eaf5-5529-42cd-a4bb-d4ecb0e642fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:27.429642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ac82eaf5-5529-42cd-a4bb-d4ecb0e642fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:27.545413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82eaf5-5529-42cd-a4bb-d4ecb0e642fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:27.546769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82eaf5-5529-42cd-a4bb-d4ecb0e642fd service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:27.565542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 657/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:29.745886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df1398-e210-47f5-b945-62ff41cb6a91 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:29.746448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df1398-e210-47f5-b945-62ff41cb6a91 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:29.746448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df1398-e210-47f5-b945-62ff41cb6a91 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:29.748061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 669/1326] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:29.753198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f6962-8977-4c0a-b5ca-fe2ed0ea6c8b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:29.753732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f6962-8977-4c0a-b5ca-fe2ed0ea6c8b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:29.753732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f6962-8977-4c0a-b5ca-fe2ed0ea6c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:29.807610 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:29.827267 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7d5f6962-8977-4c0a-b5ca-fe2ed0ea6c8b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:29.828531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7d5f6962-8977-4c0a-b5ca-fe2ed0ea6c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:29.940963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 658/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:30.219619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df1398-e210-47f5-b945-62ff41cb6a91 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:30.221228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-59df1398-e210-47f5-b945-62ff41cb6a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:30.331037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df1398-e210-47f5-b945-62ff41cb6a91 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:30.404013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea86a-c8dd-466b-8e04-c3f37cb6a236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:30.404632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea86a-c8dd-466b-8e04-c3f37cb6a236 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:30.404905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea86a-c8dd-466b-8e04-c3f37cb6a236 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:30.405246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea86a-c8dd-466b-8e04-c3f37cb6a236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:30.406936 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-322ea86a-c8dd-466b-8e04-c3f37cb6a236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:30.424035 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:30.519510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ea86a-c8dd-466b-8e04-c3f37cb6a236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:30.520851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ea86a-c8dd-466b-8e04-c3f37cb6a236 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:30.539213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 670/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:32.768051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf546d-e9f5-4380-af2b-3bb59d841dbe None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:32.768617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf546d-e9f5-4380-af2b-3bb59d841dbe None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:32.768617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf546d-e9f5-4380-af2b-3bb59d841dbe None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:32.769871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 659/1329] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:32.777087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc3d58-6225-4298-b8bc-e4a707694d93 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:32.777540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc3d58-6225-4298-b8bc-e4a707694d93 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:32.777633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc3d58-6225-4298-b8bc-e4a707694d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:32.847953 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-67fc3d58-6225-4298-b8bc-e4a707694d93 None None] MFA Rules not processed for user `f7676517cf3c47a0a7ed6087713bb3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:32.849163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-67fc3d58-6225-4298-b8bc-e4a707694d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:32.918237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:32.952106 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 671/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:33.234191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf546d-e9f5-4380-af2b-3bb59d841dbe None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:33.235858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ebbf546d-e9f5-4380-af2b-3bb59d841dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:33.348429 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf546d-e9f5-4380-af2b-3bb59d841dbe None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:33.369866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:33.424365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ff213-52b4-4ffb-931b-66031ed3f957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:33.424962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff213-52b4-4ffb-931b-66031ed3f957 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:33.425195 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff213-52b4-4ffb-931b-66031ed3f957 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:33.425489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff213-52b4-4ffb-931b-66031ed3f957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:33.427068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-947ff213-52b4-4ffb-931b-66031ed3f957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:33.549792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ff213-52b4-4ffb-931b-66031ed3f957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:33.551999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ff213-52b4-4ffb-931b-66031ed3f957 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:33.575821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 660/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:36.074113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b324fa3-0a94-4bb6-afdd-f56f90d5295f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:36.074720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b324fa3-0a94-4bb6-afdd-f56f90d5295f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:36.074720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b324fa3-0a94-4bb6-afdd-f56f90d5295f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:36.076202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 672/1332] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:36.081622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8ad07-5a44-4e82-84ce-1b32f3211aab None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:36.082050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8ad07-5a44-4e82-84ce-1b32f3211aab None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:36.082143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8ad07-5a44-4e82-84ce-1b32f3211aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:36.149339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:36.152426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a3f8ad07-5a44-4e82-84ce-1b32f3211aab None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:36.154834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a3f8ad07-5a44-4e82-84ce-1b32f3211aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:36.258648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 661/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:36.541339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b324fa3-0a94-4bb6-afdd-f56f90d5295f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:36.542875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8b324fa3-0a94-4bb6-afdd-f56f90d5295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:36.651843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b324fa3-0a94-4bb6-afdd-f56f90d5295f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:36.725979 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa440-67b3-4576-898c-41e3eee2f95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:36.726592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa440-67b3-4576-898c-41e3eee2f95a service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:36.726871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa440-67b3-4576-898c-41e3eee2f95a service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:36.727134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa440-67b3-4576-898c-41e3eee2f95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:36.728765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ab0aa440-67b3-4576-898c-41e3eee2f95a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:36.756546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:36.845823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa440-67b3-4576-898c-41e3eee2f95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:36.847240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa440-67b3-4576-898c-41e3eee2f95a service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:36.868453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 673/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:39.126145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc55a1-ed24-4483-9b01-9b7513c357c0 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:39.126780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc55a1-ed24-4483-9b01-9b7513c357c0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:39.126780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc55a1-ed24-4483-9b01-9b7513c357c0 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:39.128058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 662/1335] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:39.134717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c97680-5b9a-495f-9212-15da5b27521d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:39.135506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c97680-5b9a-495f-9212-15da5b27521d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:39.135680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c97680-5b9a-495f-9212-15da5b27521d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:39.213263 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b6c97680-5b9a-495f-9212-15da5b27521d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:39.214794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b6c97680-5b9a-495f-9212-15da5b27521d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:39.302266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:39.326810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 674/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:39.616624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc55a1-ed24-4483-9b01-9b7513c357c0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:39.618225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2acc55a1-ed24-4483-9b01-9b7513c357c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:39.724505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc55a1-ed24-4483-9b01-9b7513c357c0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:39.755969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:39.806563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e2df9-488c-4ee3-a254-00ade78ce890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:39.807165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e2df9-488c-4ee3-a254-00ade78ce890 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:39.807469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e2df9-488c-4ee3-a254-00ade78ce890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:39.807731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e2df9-488c-4ee3-a254-00ade78ce890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:39.809327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-af5e2df9-488c-4ee3-a254-00ade78ce890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:39.924191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e2df9-488c-4ee3-a254-00ade78ce890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:39.925535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e2df9-488c-4ee3-a254-00ade78ce890 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:39.943500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 663/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:24:42.535779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8455f1-da74-4656-bb57-4937e817fa54 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:42.536343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8455f1-da74-4656-bb57-4937e817fa54 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:42.536343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8455f1-da74-4656-bb57-4937e817fa54 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:42.537594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 675/1338] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:42.544090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4cbc0-5188-4752-aad6-072730a6f8bb None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:42.544819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4cbc0-5188-4752-aad6-072730a6f8bb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:42.545000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4cbc0-5188-4752-aad6-072730a6f8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:42.615628 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f1e4cbc0-5188-4752-aad6-072730a6f8bb None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:42.616823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f1e4cbc0-5188-4752-aad6-072730a6f8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:42.625566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:42.718818 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 664/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:43.005503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8455f1-da74-4656-bb57-4937e817fa54 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:43.007067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bf8455f1-da74-4656-bb57-4937e817fa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:43.134620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8455f1-da74-4656-bb57-4937e817fa54 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:43.216355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de0247-d611-4e43-9173-d25eec4e81a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:43.216962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0247-d611-4e43-9173-d25eec4e81a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:43.217246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0247-d611-4e43-9173-d25eec4e81a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:43.217533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0247-d611-4e43-9173-d25eec4e81a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:43.219159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f8de0247-d611-4e43-9173-d25eec4e81a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:43.260340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:43.339703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de0247-d611-4e43-9173-d25eec4e81a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:43.341139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de0247-d611-4e43-9173-d25eec4e81a6 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:43.361064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 676/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:47.474629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6458148-e36e-435b-ae6b-3d2f257e85a9 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:47.475193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6458148-e36e-435b-ae6b-3d2f257e85a9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:47.475193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6458148-e36e-435b-ae6b-3d2f257e85a9 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:47.476763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 665/1341] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:47.481929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7b31-d459-47e4-8f9a-5809a577e19f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:47.482391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7b31-d459-47e4-8f9a-5809a577e19f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:47.482497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7b31-d459-47e4-8f9a-5809a577e19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:47.549415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-47fd7b31-d459-47e4-8f9a-5809a577e19f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:47.550501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-47fd7b31-d459-47e4-8f9a-5809a577e19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:47.637794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:47.649547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 677/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:47.928692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6458148-e36e-435b-ae6b-3d2f257e85a9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:47.930253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d6458148-e36e-435b-ae6b-3d2f257e85a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:48.044752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6458148-e36e-435b-ae6b-3d2f257e85a9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:48.084620 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:48.125033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ad7f6-83d1-42dc-8e1a-614238a2bbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:48.125650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ad7f6-83d1-42dc-8e1a-614238a2bbcf service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:48.125927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ad7f6-83d1-42dc-8e1a-614238a2bbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:48.126195 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ad7f6-83d1-42dc-8e1a-614238a2bbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:48.127883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-786ad7f6-83d1-42dc-8e1a-614238a2bbcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:48.241042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ad7f6-83d1-42dc-8e1a-614238a2bbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:48.242496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ad7f6-83d1-42dc-8e1a-614238a2bbcf service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:48.260888 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 666/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:50.978151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e391c5-35f4-468f-9a89-d39c47446dcc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:50.978768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e391c5-35f4-468f-9a89-d39c47446dcc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:50.978768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e391c5-35f4-468f-9a89-d39c47446dcc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:50.980209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 678/1344] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:50.986279 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8bff-9ca3-4db3-9180-75da08cec050 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:50.986745 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8bff-9ca3-4db3-9180-75da08cec050 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:50.986858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8bff-9ca3-4db3-9180-75da08cec050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:51.065441 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-148f8bff-9ca3-4db3-9180-75da08cec050 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:51.066675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-148f8bff-9ca3-4db3-9180-75da08cec050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:51.085698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:51.167754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 667/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:51.448553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e391c5-35f4-468f-9a89-d39c47446dcc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:51.450173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-44e391c5-35f4-468f-9a89-d39c47446dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:51.567450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e391c5-35f4-468f-9a89-d39c47446dcc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:51.646088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7823b4e-522b-4905-9987-8d55bd64c0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:51.646703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823b4e-522b-4905-9987-8d55bd64c0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:51.646976 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823b4e-522b-4905-9987-8d55bd64c0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:51.647242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823b4e-522b-4905-9987-8d55bd64c0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:51.648913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d7823b4e-522b-4905-9987-8d55bd64c0a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:51.695372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:51.761773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7823b4e-522b-4905-9987-8d55bd64c0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:51.763214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7823b4e-522b-4905-9987-8d55bd64c0a0 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:51.784732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 679/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:24:56.012182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b72e4-9efa-4c7a-8f44-f628805da287 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:56.012715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b72e4-9efa-4c7a-8f44-f628805da287 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:56.012715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b72e4-9efa-4c7a-8f44-f628805da287 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:56.014188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 668/1347] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:24:56.019765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed66c1-5334-4dda-af56-321da643b45f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:56.020247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed66c1-5334-4dda-af56-321da643b45f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:56.020329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed66c1-5334-4dda-af56-321da643b45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:56.102434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7eed66c1-5334-4dda-af56-321da643b45f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:24:56.103745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7eed66c1-5334-4dda-af56-321da643b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:56.203795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:56.206179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 680/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:24:56.487700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b72e4-9efa-4c7a-8f44-f628805da287 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:24:56.490557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e78b72e4-9efa-4c7a-8f44-f628805da287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:56.608285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b72e4-9efa-4c7a-8f44-f628805da287 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:24:56.658322 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:24:56.689206 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4b770-0d43-4295-9187-ee17c9fdc872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:24:56.689814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4b770-0d43-4295-9187-ee17c9fdc872 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:24:56.690085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4b770-0d43-4295-9187-ee17c9fdc872 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:24:56.690349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4b770-0d43-4295-9187-ee17c9fdc872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:24:56.691957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-caf4b770-0d43-4295-9187-ee17c9fdc872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:24:56.811225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4b770-0d43-4295-9187-ee17c9fdc872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:24:56.812639 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4b770-0d43-4295-9187-ee17c9fdc872 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:24:56.833551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 669/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:01.913509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e86668-2948-425c-a45a-6cfcb54c69ed None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:01.914108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e86668-2948-425c-a45a-6cfcb54c69ed None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:01.914108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e86668-2948-425c-a45a-6cfcb54c69ed None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:01.917321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 681/1350] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:01.922420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c61f1f-b6e1-4403-b191-9ae4dc6a1f65 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:01.922879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c61f1f-b6e1-4403-b191-9ae4dc6a1f65 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:01.925065 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c61f1f-b6e1-4403-b191-9ae4dc6a1f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:02.011742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-02c61f1f-b6e1-4403-b191-9ae4dc6a1f65 None None] MFA Rules not processed for user `ff4e48fdc18e424fa2cf80fd5da332b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:02.012994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-02c61f1f-b6e1-4403-b191-9ae4dc6a1f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:02.032491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:02.199528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 670/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:25:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:25:06.345966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef300fd-3723-4c1f-ba12-dba6fcf6f4ef None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:06.346535 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef300fd-3723-4c1f-ba12-dba6fcf6f4ef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:06.346752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef300fd-3723-4c1f-ba12-dba6fcf6f4ef None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:06.348328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 682/1352] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:06.354061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000983-a75e-47fb-a82d-168a4492d81f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:06.354533 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000983-a75e-47fb-a82d-168a4492d81f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:06.354852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000983-a75e-47fb-a82d-168a4492d81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:06.436333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-34000983-a75e-47fb-a82d-168a4492d81f None None] MFA Rules not processed for user `ff4e48fdc18e424fa2cf80fd5da332b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:06.437693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-34000983-a75e-47fb-a82d-168a4492d81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:06.511238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:06.550638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 671/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:25:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:07.942694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cb5d-63c1-45c4-aff8-127d5cc9ae3a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:07.943261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cb5d-63c1-45c4-aff8-127d5cc9ae3a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:07.943261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cb5d-63c1-45c4-aff8-127d5cc9ae3a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:07.944789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 683/1354] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:07.950117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a77f-1b17-460f-88e4-eed03104add8 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:07.950560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a77f-1b17-460f-88e4-eed03104add8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:07.950659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a77f-1b17-460f-88e4-eed03104add8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:08.032562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1db6a77f-1b17-460f-88e4-eed03104add8 None None] MFA Rules not processed for user `ff4e48fdc18e424fa2cf80fd5da332b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:08.033813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1db6a77f-1b17-460f-88e4-eed03104add8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:08.144913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 672/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:25:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:11.656311 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f165700-9b1f-4500-8e82-5b95ccc52898 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:11.656896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f165700-9b1f-4500-8e82-5b95ccc52898 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:11.656896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f165700-9b1f-4500-8e82-5b95ccc52898 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:11.658194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 684/1356] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:11.663945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca1c7-25b4-4e3e-9b35-b64e027690e6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:11.664433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca1c7-25b4-4e3e-9b35-b64e027690e6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:11.664689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca1c7-25b4-4e3e-9b35-b64e027690e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:11.703130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:11.738763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7f2ca1c7-25b4-4e3e-9b35-b64e027690e6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:11.740554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7f2ca1c7-25b4-4e3e-9b35-b64e027690e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:11.841013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 673/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:12.140283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faae5fe-1a0f-4839-bfa6-d515e1c6e27b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:12.140849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faae5fe-1a0f-4839-bfa6-d515e1c6e27b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:12.141362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faae5fe-1a0f-4839-bfa6-d515e1c6e27b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:12.143556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 685/1358] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 6 04:25:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:12.151247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457509db-4ad3-4a48-b587-f49e34216c0a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:12.151541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457509db-4ad3-4a48-b587-f49e34216c0a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:12.151841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457509db-4ad3-4a48-b587-f49e34216c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:12.245736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-457509db-4ad3-4a48-b587-f49e34216c0a None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:12.247295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-457509db-4ad3-4a48-b587-f49e34216c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:12.299508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:12.382611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 674/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 6 04:25:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:12.391011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faae5fe-1a0f-4839-bfa6-d515e1c6e27b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:12.392761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1faae5fe-1a0f-4839-bfa6-d515e1c6e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:12.551548 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faae5fe-1a0f-4839-bfa6-d515e1c6e27b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:12.624842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:12.666184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68d052-3f51-47fa-a2b1-d76432d1b1a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:12.668012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d052-3f51-47fa-a2b1-d76432d1b1a5 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:12.668012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d052-3f51-47fa-a2b1-d76432d1b1a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:12.668012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d052-3f51-47fa-a2b1-d76432d1b1a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:12.669194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4a68d052-3f51-47fa-a2b1-d76432d1b1a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:12.770829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68d052-3f51-47fa-a2b1-d76432d1b1a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:12.772719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68d052-3f51-47fa-a2b1-d76432d1b1a5 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:12.791826 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 686/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:15.142718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb30e-9351-4842-b802-82240f6ab1da None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:15.142718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb30e-9351-4842-b802-82240f6ab1da None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:15.144275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb30e-9351-4842-b802-82240f6ab1da None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:15.149801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8e26e-6fa5-41e8-a7a9-4f8061438c75 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:15.150414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8e26e-6fa5-41e8-a7a9-4f8061438c75 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:15.150414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8e26e-6fa5-41e8-a7a9-4f8061438c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:15.155051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 675/1361] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:15.217794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bdd8e26e-6fa5-41e8-a7a9-4f8061438c75 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:15.218865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bdd8e26e-6fa5-41e8-a7a9-4f8061438c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:15.260191 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:15.328454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 687/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:25:15.610095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddb30e-9351-4842-b802-82240f6ab1da None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:15.611685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f3ddb30e-9351-4842-b802-82240f6ab1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:15.812753 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddb30e-9351-4842-b802-82240f6ab1da None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:15.823906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:15.950137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790bb57-c9d9-4409-8445-63ca457f2672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:15.950819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790bb57-c9d9-4409-8445-63ca457f2672 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:15.951202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790bb57-c9d9-4409-8445-63ca457f2672 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:15.951675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790bb57-c9d9-4409-8445-63ca457f2672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:15.953316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4790bb57-c9d9-4409-8445-63ca457f2672 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:16.045326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790bb57-c9d9-4409-8445-63ca457f2672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:16.046938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790bb57-c9d9-4409-8445-63ca457f2672 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:16.065371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 676/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:18.590580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1ae1c-e8ee-4c7f-9270-4e060ba20c87 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:18.591112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1ae1c-e8ee-4c7f-9270-4e060ba20c87 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:18.591112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1ae1c-e8ee-4c7f-9270-4e060ba20c87 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:18.593043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 688/1364] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:18.598721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180bd07-4436-4dd7-978c-39bf719d05ee None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:18.599166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180bd07-4436-4dd7-978c-39bf719d05ee None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:18.599267 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180bd07-4436-4dd7-978c-39bf719d05ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:18.617188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:18.673801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5180bd07-4436-4dd7-978c-39bf719d05ee None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:18.675339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5180bd07-4436-4dd7-978c-39bf719d05ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:18.780479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 677/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:25:19.067185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc33db4-0a2a-48a9-80fc-ed19541f6bc8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:19.067529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc33db4-0a2a-48a9-80fc-ed19541f6bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:19.067725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc33db4-0a2a-48a9-80fc-ed19541f6bc8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:19.069215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 689/1366] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 6 04:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:19.074585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62630e-4b17-47af-bd14-cd6ac554d36f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:19.075246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62630e-4b17-47af-bd14-cd6ac554d36f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:19.075954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62630e-4b17-47af-bd14-cd6ac554d36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:19.154393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5f62630e-4b17-47af-bd14-cd6ac554d36f None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:19.155635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5f62630e-4b17-47af-bd14-cd6ac554d36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:19.195790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:19.280824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 678/1367] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 6 04:25:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:19.288588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc33db4-0a2a-48a9-80fc-ed19541f6bc8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:19.290097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4cc33db4-0a2a-48a9-80fc-ed19541f6bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:19.449091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc33db4-0a2a-48a9-80fc-ed19541f6bc8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:19.472996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:19.578780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4116-de0a-472e-8dce-6c227ebd3bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:19.579294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4116-de0a-472e-8dce-6c227ebd3bc1 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:19.579755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4116-de0a-472e-8dce-6c227ebd3bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:19.580134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4116-de0a-472e-8dce-6c227ebd3bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:19.581760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-edea4116-de0a-472e-8dce-6c227ebd3bc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:19.687614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea4116-de0a-472e-8dce-6c227ebd3bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:19.689245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea4116-de0a-472e-8dce-6c227ebd3bc1 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:19.709208 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 690/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:19.729515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182afb00-a754-4f96-9ba0-f4253bb75853 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:19.730034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182afb00-a754-4f96-9ba0-f4253bb75853 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:19.730034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182afb00-a754-4f96-9ba0-f4253bb75853 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:19.731583 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 679/1369] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:19.737079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e38a-82ae-4831-a561-e4ffd2245226 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:19.737356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e38a-82ae-4831-a561-e4ffd2245226 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:19.737605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e38a-82ae-4831-a561-e4ffd2245226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:19.774391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:19.823593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cde5e38a-82ae-4831-a561-e4ffd2245226 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:19.823593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cde5e38a-82ae-4831-a561-e4ffd2245226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:19.939348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 691/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:25:20.273552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5b30d-68db-403c-98ba-2ffe457b7f67 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:20.273552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5b30d-68db-403c-98ba-2ffe457b7f67 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:20.273552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5b30d-68db-403c-98ba-2ffe457b7f67 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:20.276789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 680/1371] 10.222.0.20 () {54 vars in 963 bytes} [Thu Oct 6 04:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:20.280589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552b97-c63d-4d8b-9a50-1ee4e8562cbb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:20.280589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552b97-c63d-4d8b-9a50-1ee4e8562cbb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:20.280589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552b97-c63d-4d8b-9a50-1ee4e8562cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:20.361890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9e552b97-c63d-4d8b-9a50-1ee4e8562cbb None None] MFA Rules not processed for user `e66a78c94f03443cbae595bba07e458d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:20.363441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9e552b97-c63d-4d8b-9a50-1ee4e8562cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:20.414743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:20.447861 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 692/1372] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Oct 6 04:25:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:20.456358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5b30d-68db-403c-98ba-2ffe457b7f67 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:20.457908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7cb5b30d-68db-403c-98ba-2ffe457b7f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:20.568986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5b30d-68db-403c-98ba-2ffe457b7f67 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:20.613454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:20.651522 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cf1c7-9d5f-44ea-9e7d-f5ef7ca03bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:20.652152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cf1c7-9d5f-44ea-9e7d-f5ef7ca03bfa service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:20.652432 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cf1c7-9d5f-44ea-9e7d-f5ef7ca03bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:20.652705 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cf1c7-9d5f-44ea-9e7d-f5ef7ca03bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:20.654365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c97cf1c7-9d5f-44ea-9e7d-f5ef7ca03bfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:20.791963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cf1c7-9d5f-44ea-9e7d-f5ef7ca03bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:20.795447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cf1c7-9d5f-44ea-9e7d-f5ef7ca03bfa service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:20.822564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 681/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:21.937407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e1d05-0fb9-4dde-a2ff-f8029ddf6a31 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:21.937986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e1d05-0fb9-4dde-a2ff-f8029ddf6a31 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:21.938077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e1d05-0fb9-4dde-a2ff-f8029ddf6a31 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:21.939454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 693/1374] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:21.945111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440a185-abac-46b2-9e72-e028a5b78cd4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:21.945559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440a185-abac-46b2-9e72-e028a5b78cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:21.945710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440a185-abac-46b2-9e72-e028a5b78cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:22.014171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6440a185-abac-46b2-9e72-e028a5b78cd4 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:22.015434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6440a185-abac-46b2-9e72-e028a5b78cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:22.036166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:22.116295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 682/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:22.404110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e1d05-0fb9-4dde-a2ff-f8029ddf6a31 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:22.405738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bd3e1d05-0fb9-4dde-a2ff-f8029ddf6a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:22.559998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e1d05-0fb9-4dde-a2ff-f8029ddf6a31 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:22.613484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:22.676352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a144ef-3975-4618-be3e-2700ea5ab91b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:22.676967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a144ef-3975-4618-be3e-2700ea5ab91b service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:22.677239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a144ef-3975-4618-be3e-2700ea5ab91b service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:22.677504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a144ef-3975-4618-be3e-2700ea5ab91b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:22.679108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-97a144ef-3975-4618-be3e-2700ea5ab91b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:22.773480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a144ef-3975-4618-be3e-2700ea5ab91b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:22.775211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a144ef-3975-4618-be3e-2700ea5ab91b service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:22.793486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 694/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:25.027189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434264df-9ede-4c64-9dab-11bb2a31b41d None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:25.027764 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434264df-9ede-4c64-9dab-11bb2a31b41d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:25.027764 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434264df-9ede-4c64-9dab-11bb2a31b41d None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:25.029268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 683/1377] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:25.035047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9449b4-34d5-4379-ad26-b6cc67e1aa78 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:25.035482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9449b4-34d5-4379-ad26-b6cc67e1aa78 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:25.035667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9449b4-34d5-4379-ad26-b6cc67e1aa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:25.115980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3f9449b4-34d5-4379-ad26-b6cc67e1aa78 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:25.117204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3f9449b4-34d5-4379-ad26-b6cc67e1aa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:25.125340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:25.235359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 695/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:25.524217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434264df-9ede-4c64-9dab-11bb2a31b41d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:25.525846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-434264df-9ede-4c64-9dab-11bb2a31b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:25.682008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434264df-9ede-4c64-9dab-11bb2a31b41d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:25.686124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:25.799500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6b230-1201-44be-9b3c-1f2ed02162b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:25.800119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6b230-1201-44be-9b3c-1f2ed02162b8 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:25.800393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6b230-1201-44be-9b3c-1f2ed02162b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:25.800663 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6b230-1201-44be-9b3c-1f2ed02162b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:25.802343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b3c6b230-1201-44be-9b3c-1f2ed02162b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:25.897330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6b230-1201-44be-9b3c-1f2ed02162b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:25.898814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6b230-1201-44be-9b3c-1f2ed02162b8 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:25.917805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 684/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:28.140027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465815d6-4ea2-4c70-8a5d-c7074a7a74fc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:28.141321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465815d6-4ea2-4c70-8a5d-c7074a7a74fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:28.141321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465815d6-4ea2-4c70-8a5d-c7074a7a74fc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:28.145960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 696/1380] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:28.147370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c8dc7-0eb7-4346-b710-a2e99ae4e433 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:28.147969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c8dc7-0eb7-4346-b710-a2e99ae4e433 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:28.147969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c8dc7-0eb7-4346-b710-a2e99ae4e433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:28.165986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:28.254480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ab4c8dc7-0eb7-4346-b710-a2e99ae4e433 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:28.255645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ab4c8dc7-0eb7-4346-b710-a2e99ae4e433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:28.363778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 685/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:28.656404 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465815d6-4ea2-4c70-8a5d-c7074a7a74fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:28.658954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-465815d6-4ea2-4c70-8a5d-c7074a7a74fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:28.805457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:28.816654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465815d6-4ea2-4c70-8a5d-c7074a7a74fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:28.934242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f09b4d-ed60-43c0-9943-552d7bede1e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:28.934858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f09b4d-ed60-43c0-9943-552d7bede1e3 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:28.935483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f09b4d-ed60-43c0-9943-552d7bede1e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:28.935761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f09b4d-ed60-43c0-9943-552d7bede1e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:28.937393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d9f09b4d-ed60-43c0-9943-552d7bede1e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:29.032302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f09b4d-ed60-43c0-9943-552d7bede1e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:29.034057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f09b4d-ed60-43c0-9943-552d7bede1e3 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:29.044364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:29.054786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 697/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:31.271564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28398dd3-ff0b-48f3-8483-36a02d933368 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:31.272207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28398dd3-ff0b-48f3-8483-36a02d933368 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:31.272207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28398dd3-ff0b-48f3-8483-36a02d933368 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:31.273552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 686/1383] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:25:31.279919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440d2d-f5fd-4b08-a82e-54505f86e87b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:31.280397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440d2d-f5fd-4b08-a82e-54505f86e87b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:31.280733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440d2d-f5fd-4b08-a82e-54505f86e87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:31.371407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e2440d2d-f5fd-4b08-a82e-54505f86e87b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:31.373123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e2440d2d-f5fd-4b08-a82e-54505f86e87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:31.497616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 698/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:31.786601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28398dd3-ff0b-48f3-8483-36a02d933368 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:31.788258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-28398dd3-ff0b-48f3-8483-36a02d933368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:31.902220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:31.971806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28398dd3-ff0b-48f3-8483-36a02d933368 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:32.104645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422299f4-2dc8-4610-aba0-4c9317625a01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:32.105305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422299f4-2dc8-4610-aba0-4c9317625a01 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:32.105579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422299f4-2dc8-4610-aba0-4c9317625a01 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:32.105859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422299f4-2dc8-4610-aba0-4c9317625a01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:32.107866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-422299f4-2dc8-4610-aba0-4c9317625a01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:32.161602 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:32.206339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422299f4-2dc8-4610-aba0-4c9317625a01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:32.208108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422299f4-2dc8-4610-aba0-4c9317625a01 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:32.232962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 687/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:34.454371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98009b46-0020-4ba5-b961-45e9aef103cf None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:34.454938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98009b46-0020-4ba5-b961-45e9aef103cf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:34.454938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98009b46-0020-4ba5-b961-45e9aef103cf None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:34.456664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 699/1386] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:34.470491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333d56f-6e91-405b-92f8-085d23b9c273 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:34.471023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333d56f-6e91-405b-92f8-085d23b9c273 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:34.471226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333d56f-6e91-405b-92f8-085d23b9c273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:34.565899 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5333d56f-6e91-405b-92f8-085d23b9c273 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:34.567692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5333d56f-6e91-405b-92f8-085d23b9c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:34.684216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 688/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:34.973356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98009b46-0020-4ba5-b961-45e9aef103cf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:34.975024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-98009b46-0020-4ba5-b961-45e9aef103cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:35.069895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:35.144843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98009b46-0020-4ba5-b961-45e9aef103cf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:35.258145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5c57-ed3f-442b-a766-ddff1930eba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:35.258671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5c57-ed3f-442b-a766-ddff1930eba1 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:35.258942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5c57-ed3f-442b-a766-ddff1930eba1 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:35.259205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5c57-ed3f-442b-a766-ddff1930eba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:35.260820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-983f5c57-ed3f-442b-a766-ddff1930eba1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:35.301365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:35.356179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f5c57-ed3f-442b-a766-ddff1930eba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:35.357816 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f5c57-ed3f-442b-a766-ddff1930eba1 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:35.376638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 700/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:25:37.145794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9a2e6-0eb4-413c-88ef-047c36be3d11 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:37.146454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9a2e6-0eb4-413c-88ef-047c36be3d11 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:37.146454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9a2e6-0eb4-413c-88ef-047c36be3d11 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:37.147766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 689/1389] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:37.153137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba70f71-0001-4350-b7b4-3125eaa18942 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:37.153619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba70f71-0001-4350-b7b4-3125eaa18942 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:37.153880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba70f71-0001-4350-b7b4-3125eaa18942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:37.222263 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dba70f71-0001-4350-b7b4-3125eaa18942 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:37.223508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dba70f71-0001-4350-b7b4-3125eaa18942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:37.324169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 701/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:37.565622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7cda-bb72-46d6-afbd-8cd5ce5593c1 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:37.566000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7cda-bb72-46d6-afbd-8cd5ce5593c1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:37.566284 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7cda-bb72-46d6-afbd-8cd5ce5593c1 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:37.567714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 690/1391] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:37.573364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb15eeb-8071-4883-836d-3e2657c581eb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:37.573655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb15eeb-8071-4883-836d-3e2657c581eb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:37.573927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb15eeb-8071-4883-836d-3e2657c581eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:37.591851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:37.618933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d151e08-498b-47f2-bf8c-b26161300d52 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:37.619213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d151e08-498b-47f2-bf8c-b26161300d52 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:37.619526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d151e08-498b-47f2-bf8c-b26161300d52 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:37.620898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 691/1392] 10.222.0.20 () {54 vars in 962 bytes} [Thu Oct 6 04:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:37.626261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a255da-e486-422c-9f42-880e2531afbc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:37.626540 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a255da-e486-422c-9f42-880e2531afbc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:37.626809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a255da-e486-422c-9f42-880e2531afbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:37.647274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0eb15eeb-8071-4883-836d-3e2657c581eb None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:37.648917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0eb15eeb-8071-4883-836d-3e2657c581eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:37.659480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:37.714988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-92a255da-e486-422c-9f42-880e2531afbc None None] MFA Rules not processed for user `457880195ed849d2b594ddea6acdf7df`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:37.716272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-92a255da-e486-422c-9f42-880e2531afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:37.754613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 702/1393] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:37.794023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 692/1394] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Oct 6 04:25:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:37.803794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb15eeb-8071-4883-836d-3e2657c581eb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:37.805009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0eb15eeb-8071-4883-836d-3e2657c581eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:37.902313 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb15eeb-8071-4883-836d-3e2657c581eb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:37.910247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:37.976453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26d6b4-790b-425d-a2a6-0e4cff911125 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '457880195ed849d2b594ddea6acdf7df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:37.977062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26d6b4-790b-425d-a2a6-0e4cff911125 service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:37.977339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26d6b4-790b-425d-a2a6-0e4cff911125 service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:37.977609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26d6b4-790b-425d-a2a6-0e4cff911125 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:37.979203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5e26d6b4-790b-425d-a2a6-0e4cff911125 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:38.041319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a255da-e486-422c-9f42-880e2531afbc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:38.042544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-92a255da-e486-422c-9f42-880e2531afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:38.095653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26d6b4-790b-425d-a2a6-0e4cff911125 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:38.097100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26d6b4-790b-425d-a2a6-0e4cff911125 service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:38.116204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 703/1395] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:38.163572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a255da-e486-422c-9f42-880e2531afbc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:38.167440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:38.282602 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0662d-d55e-4530-9b3d-8f53324aaaeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:38.283211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0662d-d55e-4530-9b3d-8f53324aaaeb service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:38.283490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0662d-d55e-4530-9b3d-8f53324aaaeb service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:38.283761 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0662d-d55e-4530-9b3d-8f53324aaaeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:38.285342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bde0662d-d55e-4530-9b3d-8f53324aaaeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:38.392521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0662d-d55e-4530-9b3d-8f53324aaaeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:38.394155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0662d-d55e-4530-9b3d-8f53324aaaeb service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:38.414113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 693/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:25:38.872449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3fc8e-07d8-4c22-b8cc-9091af016e02 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:38.872971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3fc8e-07d8-4c22-b8cc-9091af016e02 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:38.873068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3fc8e-07d8-4c22-b8cc-9091af016e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:38.928514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:38.956465 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7fc3fc8e-07d8-4c22-b8cc-9091af016e02 None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:38.957664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7fc3fc8e-07d8-4c22-b8cc-9091af016e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:39.048385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 704/1397] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:25:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:39.097901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e9b91-185c-4e67-8df8-fb37dd01cf23 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:39.098182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e9b91-185c-4e67-8df8-fb37dd01cf23 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:39.098466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e9b91-185c-4e67-8df8-fb37dd01cf23 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:39.100979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 694/1398] 10.222.0.20 () {54 vars in 943 bytes} [Thu Oct 6 04:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:39.113218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbae6d-0dd1-474b-b861-03b80538b2e7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:39.113467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbae6d-0dd1-474b-b861-03b80538b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:39.114114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbae6d-0dd1-474b-b861-03b80538b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:39.217834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-93cbae6d-0dd1-474b-b861-03b80538b2e7 None None] MFA Rules not processed for user `85602a9d62bc475fb5da609f97958d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:39.219172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-93cbae6d-0dd1-474b-b861-03b80538b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:39.312116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:39.378228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 705/1399] 10.222.0.20 () {58 vars in 1040 bytes} [Thu Oct 6 04:25:39 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:39.388590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e9b91-185c-4e67-8df8-fb37dd01cf23 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:39.390229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cd4e9b91-185c-4e67-8df8-fb37dd01cf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:39.400709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:39.546642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e9b91-185c-4e67-8df8-fb37dd01cf23 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:39.665907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:39.673711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dc639-2c86-4b47-a5ba-0554e35d726f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:39.674558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dc639-2c86-4b47-a5ba-0554e35d726f service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:39.675003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dc639-2c86-4b47-a5ba-0554e35d726f service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:39.675600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dc639-2c86-4b47-a5ba-0554e35d726f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:39.677666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-913dc639-2c86-4b47-a5ba-0554e35d726f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:39.774637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dc639-2c86-4b47-a5ba-0554e35d726f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:39.776431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dc639-2c86-4b47-a5ba-0554e35d726f service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:39.789657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 695/1400] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:25:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:25:40.732383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82e42-46f7-479c-967c-9edf3266b70b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:40.733068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82e42-46f7-479c-967c-9edf3266b70b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:40.733068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82e42-46f7-479c-967c-9edf3266b70b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:40.735845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 706/1401] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:40.740569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00473d3-2019-4fd7-a620-3405e6d66754 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:40.741075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00473d3-2019-4fd7-a620-3405e6d66754 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:40.741166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00473d3-2019-4fd7-a620-3405e6d66754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:40.835618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b00473d3-2019-4fd7-a620-3405e6d66754 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:40.836838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b00473d3-2019-4fd7-a620-3405e6d66754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:40.921885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:40.941891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 696/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:41.237398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82e42-46f7-479c-967c-9edf3266b70b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:41.239319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b9e82e42-46f7-479c-967c-9edf3266b70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:41.402817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82e42-46f7-479c-967c-9edf3266b70b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:41.446926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:41.526767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fd359-26dd-4e10-8fc6-524da69c7194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:41.527405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fd359-26dd-4e10-8fc6-524da69c7194 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:41.527681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fd359-26dd-4e10-8fc6-524da69c7194 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:41.527940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fd359-26dd-4e10-8fc6-524da69c7194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:41.529689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-976fd359-26dd-4e10-8fc6-524da69c7194 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:41.624416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fd359-26dd-4e10-8fc6-524da69c7194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:41.625920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fd359-26dd-4e10-8fc6-524da69c7194 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:41.647029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 707/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:43.860379 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc53708-9e89-4772-a1f6-a03b13536ecb None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:43.860994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc53708-9e89-4772-a1f6-a03b13536ecb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:43.860994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc53708-9e89-4772-a1f6-a03b13536ecb None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:43.868262 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3e24-a36b-4232-bcc7-c17347722a06 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:43.868696 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3e24-a36b-4232-bcc7-c17347722a06 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:43.868857 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3e24-a36b-4232-bcc7-c17347722a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:43.873550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 697/1404] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:43.933783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:43.943096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-348e3e24-a36b-4232-bcc7-c17347722a06 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:43.944864 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-348e3e24-a36b-4232-bcc7-c17347722a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:44.083083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 708/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:44.370539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc53708-9e89-4772-a1f6-a03b13536ecb None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:44.372315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cfc53708-9e89-4772-a1f6-a03b13536ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:44.528286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc53708-9e89-4772-a1f6-a03b13536ecb None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:44.593782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:44.652061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df17355-9db0-440e-9305-8e70ccb05d45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:44.652680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17355-9db0-440e-9305-8e70ccb05d45 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:44.652955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17355-9db0-440e-9305-8e70ccb05d45 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:44.653248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17355-9db0-440e-9305-8e70ccb05d45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:44.654866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2df17355-9db0-440e-9305-8e70ccb05d45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:44.749832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df17355-9db0-440e-9305-8e70ccb05d45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:44.753347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df17355-9db0-440e-9305-8e70ccb05d45 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:44.770830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 698/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:46.976025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e0fa6-020f-4c65-8eb2-034d90730077 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:46.976637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e0fa6-020f-4c65-8eb2-034d90730077 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:46.976637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e0fa6-020f-4c65-8eb2-034d90730077 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:46.978049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 709/1407] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:25:46.984058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed6b26-7f98-4785-a86c-11cc964f9a52 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:46.984058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed6b26-7f98-4785-a86c-11cc964f9a52 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:46.984756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed6b26-7f98-4785-a86c-11cc964f9a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:47.062520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-bfed6b26-7f98-4785-a86c-11cc964f9a52 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:25:47.063779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bfed6b26-7f98-4785-a86c-11cc964f9a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:47.086923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:47.175363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 699/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:25:47.461937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e0fa6-020f-4c65-8eb2-034d90730077 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:25:47.464535 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6b0e0fa6-020f-4c65-8eb2-034d90730077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:47.599616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:47.631003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e0fa6-020f-4c65-8eb2-034d90730077 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:25:47.757560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56393a31-8a17-4e22-81d6-eee3be3a6d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:25:47.758181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393a31-8a17-4e22-81d6-eee3be3a6d9e service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:25:47.758457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393a31-8a17-4e22-81d6-eee3be3a6d9e service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:25:47.758724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393a31-8a17-4e22-81d6-eee3be3a6d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:25:47.760442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-56393a31-8a17-4e22-81d6-eee3be3a6d9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:25:47.859824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:47.864972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56393a31-8a17-4e22-81d6-eee3be3a6d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:25:47.866873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56393a31-8a17-4e22-81d6-eee3be3a6d9e service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:25:47.888848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 710/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:25:57.170354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=33 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:57.886403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:02.068173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc922f8-4a10-4258-a321-dbe1dac249fb None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:02.068790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc922f8-4a10-4258-a321-dbe1dac249fb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:02.068790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc922f8-4a10-4258-a321-dbe1dac249fb None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:02.070075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 700/1410] 10.222.0.20 () {54 vars in 918 bytes} [Thu Oct 6 04:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:02.075409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658ffe9-590a-4cc1-a78f-31f2544ca0fd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:02.075873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658ffe9-590a-4cc1-a78f-31f2544ca0fd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:02.075988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658ffe9-590a-4cc1-a78f-31f2544ca0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:02.154074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5658ffe9-590a-4cc1-a78f-31f2544ca0fd None None] MFA Rules not processed for user `ff4e48fdc18e424fa2cf80fd5da332b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:02.155272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5658ffe9-590a-4cc1-a78f-31f2544ca0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:02.269178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 711/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Oct 6 04:26:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:02.283999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821af1-28fd-4c3a-9e6e-044a52cdc8ca None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:02.284278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821af1-28fd-4c3a-9e6e-044a52cdc8ca None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:02.284548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821af1-28fd-4c3a-9e6e-044a52cdc8ca None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:02.285897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 701/1412] 10.222.0.20 () {54 vars in 918 bytes} [Thu Oct 6 04:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:02.290911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891306b8-1ed2-4b7e-b8da-ff7d1c8fe1e7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:02.291193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891306b8-1ed2-4b7e-b8da-ff7d1c8fe1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:02.291524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891306b8-1ed2-4b7e-b8da-ff7d1c8fe1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:02.368749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:02.371867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-891306b8-1ed2-4b7e-b8da-ff7d1c8fe1e7 None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:02.373930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-891306b8-1ed2-4b7e-b8da-ff7d1c8fe1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:02.494484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 712/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Oct 6 04:26:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:05.058071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63af94c-cb0a-4b12-835e-e62423497557 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:05.059435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63af94c-cb0a-4b12-835e-e62423497557 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:05.059435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63af94c-cb0a-4b12-835e-e62423497557 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:05.060562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:05.066071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11080-d6d0-4cb1-8240-fb203db7ceb2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:05.066534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11080-d6d0-4cb1-8240-fb203db7ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:05.066639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11080-d6d0-4cb1-8240-fb203db7ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:05.137975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b6d11080-d6d0-4cb1-8240-fb203db7ceb2 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:05.139181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b6d11080-d6d0-4cb1-8240-fb203db7ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:05.200117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:05.244144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:05.539259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63af94c-cb0a-4b12-835e-e62423497557 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:05.541683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e63af94c-cb0a-4b12-835e-e62423497557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:05.699248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63af94c-cb0a-4b12-835e-e62423497557 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:05.777139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:05.818247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba6b2d-ef6d-42c8-9f29-53106c6b59f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:05.818846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba6b2d-ef6d-42c8-9f29-53106c6b59f9 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:05.819119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba6b2d-ef6d-42c8-9f29-53106c6b59f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:05.819418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba6b2d-ef6d-42c8-9f29-53106c6b59f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:05.821016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-80ba6b2d-ef6d-42c8-9f29-53106c6b59f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:05.914235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba6b2d-ef6d-42c8-9f29-53106c6b59f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:05.915846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba6b2d-ef6d-42c8-9f29-53106c6b59f9 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:05.934060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 703/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:07.067251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d147-5e63-42f1-97e9-36a279350f63 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:07.067887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d147-5e63-42f1-97e9-36a279350f63 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:07.067887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d147-5e63-42f1-97e9-36a279350f63 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:07.069180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:07.077080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025e78b-1879-47ce-b12e-251970335b10 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:07.077540 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025e78b-1879-47ce-b12e-251970335b10 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:07.077661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025e78b-1879-47ce-b12e-251970335b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:07.173237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0025e78b-1879-47ce-b12e-251970335b10 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:07.174445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0025e78b-1879-47ce-b12e-251970335b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:07.201829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:07.402220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:07.555230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285d147-5e63-42f1-97e9-36a279350f63 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:07.557822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1285d147-5e63-42f1-97e9-36a279350f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:07.716222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285d147-5e63-42f1-97e9-36a279350f63 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:07.758282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:07.831469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3783612-f8af-474b-8203-52c251a80f3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:07.832073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3783612-f8af-474b-8203-52c251a80f3e service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:07.832346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3783612-f8af-474b-8203-52c251a80f3e service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:07.832608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3783612-f8af-474b-8203-52c251a80f3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:07.834217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b3783612-f8af-474b-8203-52c251a80f3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:07.933801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3783612-f8af-474b-8203-52c251a80f3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:07.935290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3783612-f8af-474b-8203-52c251a80f3e service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:07.955725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 715/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:09.090676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20527-2b39-4287-9ae7-57d1fdc2d8a3 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:09.091470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20527-2b39-4287-9ae7-57d1fdc2d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:09.091743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20527-2b39-4287-9ae7-57d1fdc2d8a3 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:09.093111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:09.100616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d85a12-f123-4a11-98e5-79bea7a3a3b7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:09.101070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d85a12-f123-4a11-98e5-79bea7a3a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:09.101194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d85a12-f123-4a11-98e5-79bea7a3a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:09.171362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:09.194692 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-35d85a12-f123-4a11-98e5-79bea7a3a3b7 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:09.195948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-35d85a12-f123-4a11-98e5-79bea7a3a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:09.303896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:09.457072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20527-2b39-4287-9ae7-57d1fdc2d8a3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:09.459381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bdc20527-2b39-4287-9ae7-57d1fdc2d8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:09.639010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20527-2b39-4287-9ae7-57d1fdc2d8a3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:09.651327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:09.761583 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018499bb-310e-4240-9ea6-f82fa554f4ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:09.762110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018499bb-310e-4240-9ea6-f82fa554f4ef service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:09.762422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018499bb-310e-4240-9ea6-f82fa554f4ef service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:09.762694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018499bb-310e-4240-9ea6-f82fa554f4ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:09.764432 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-018499bb-310e-4240-9ea6-f82fa554f4ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:09.866120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018499bb-310e-4240-9ea6-f82fa554f4ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:09.867754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018499bb-310e-4240-9ea6-f82fa554f4ef service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:09.885875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 706/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:10.998480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9906e9-b80d-4c95-96b0-0fe74850b080 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:10.999138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9906e9-b80d-4c95-96b0-0fe74850b080 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:10.999138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9906e9-b80d-4c95-96b0-0fe74850b080 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:11.000525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:11.007695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be93000-48da-44f7-be80-24d1a1bf8c10 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:11.008236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be93000-48da-44f7-be80-24d1a1bf8c10 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:11.008236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be93000-48da-44f7-be80-24d1a1bf8c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:11.030380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:11.087678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4be93000-48da-44f7-be80-24d1a1bf8c10 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:11.088912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4be93000-48da-44f7-be80-24d1a1bf8c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:11.189185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:11.338842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9906e9-b80d-4c95-96b0-0fe74850b080 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:11.340425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ca9906e9-b80d-4c95-96b0-0fe74850b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:11.464676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:11.501374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9906e9-b80d-4c95-96b0-0fe74850b080 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:11.631520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf3f42-46ab-4f5d-864d-9b663f238ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:11.632036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf3f42-46ab-4f5d-864d-9b663f238ca5 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:11.632315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf3f42-46ab-4f5d-864d-9b663f238ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:11.632571 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf3f42-46ab-4f5d-864d-9b663f238ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:11.634175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-72cf3f42-46ab-4f5d-864d-9b663f238ca5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:11.723038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:11.738773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf3f42-46ab-4f5d-864d-9b663f238ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:11.740816 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf3f42-46ab-4f5d-864d-9b663f238ca5 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:11.759870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 718/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:12.871386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb73408-91cf-4883-9fda-507b4eae3341 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:12.872271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb73408-91cf-4883-9fda-507b4eae3341 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:12.872604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb73408-91cf-4883-9fda-507b4eae3341 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:12.874062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:26:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:12.881847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e79a-dac7-490d-bb42-d93e1046a1ce None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:12.882351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e79a-dac7-490d-bb42-d93e1046a1ce None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:12.882467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e79a-dac7-490d-bb42-d93e1046a1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:12.983737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f4c8e79a-dac7-490d-bb42-d93e1046a1ce None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:12.984964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f4c8e79a-dac7-490d-bb42-d93e1046a1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:13.115492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:13.267124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb73408-91cf-4883-9fda-507b4eae3341 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:13.268679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-abb73408-91cf-4883-9fda-507b4eae3341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:13.359611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:13.423611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb73408-91cf-4883-9fda-507b4eae3341 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:13.541570 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4e212-7a77-4e32-9e3e-6d574b69f717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:13.542202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4e212-7a77-4e32-9e3e-6d574b69f717 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:13.542475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4e212-7a77-4e32-9e3e-6d574b69f717 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:13.542741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4e212-7a77-4e32-9e3e-6d574b69f717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:13.544446 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-14b4e212-7a77-4e32-9e3e-6d574b69f717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:13.596720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:13.638141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4e212-7a77-4e32-9e3e-6d574b69f717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:13.639775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4e212-7a77-4e32-9e3e-6d574b69f717 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:13.657925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 709/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:14.729195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272a61a-b8df-4797-89d1-b4b8e1aabfd7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:14.729804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272a61a-b8df-4797-89d1-b4b8e1aabfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:14.729804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272a61a-b8df-4797-89d1-b4b8e1aabfd7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:14.731239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:14.738797 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bd192-3eea-46ac-9426-83f6b6ac099d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:14.739996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bd192-3eea-46ac-9426-83f6b6ac099d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:14.740316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bd192-3eea-46ac-9426-83f6b6ac099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:14.828876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4d5bd192-3eea-46ac-9426-83f6b6ac099d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:14.830080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4d5bd192-3eea-46ac-9426-83f6b6ac099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:14.931394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:15.094734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272a61a-b8df-4797-89d1-b4b8e1aabfd7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:15.096232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9272a61a-b8df-4797-89d1-b4b8e1aabfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:15.147660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:15.257684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272a61a-b8df-4797-89d1-b4b8e1aabfd7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:15.378917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bed1e7-7e6f-42ac-90cd-6eb68574c70d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:15.379477 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed1e7-7e6f-42ac-90cd-6eb68574c70d service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:15.379753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed1e7-7e6f-42ac-90cd-6eb68574c70d service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:15.380021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed1e7-7e6f-42ac-90cd-6eb68574c70d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:15.381631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e4bed1e7-7e6f-42ac-90cd-6eb68574c70d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:15.388841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:15.477450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bed1e7-7e6f-42ac-90cd-6eb68574c70d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:15.479063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bed1e7-7e6f-42ac-90cd-6eb68574c70d service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:15.498650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 721/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:16.557240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5be00-b753-4901-be46-5d4de06d37ae None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:16.558120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5be00-b753-4901-be46-5d4de06d37ae None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:16.558120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5be00-b753-4901-be46-5d4de06d37ae None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:16.560320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:26:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:16.566891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061aefa-0f57-488d-9b28-c01dbcae2906 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:16.567429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061aefa-0f57-488d-9b28-c01dbcae2906 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:16.567429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061aefa-0f57-488d-9b28-c01dbcae2906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:16.645505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1061aefa-0f57-488d-9b28-c01dbcae2906 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:16.646698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1061aefa-0f57-488d-9b28-c01dbcae2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:16.716800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:16.747973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:16.901590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5be00-b753-4901-be46-5d4de06d37ae None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:16.903920 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a5c5be00-b753-4901-be46-5d4de06d37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:16.928476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:17.064338 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5be00-b753-4901-be46-5d4de06d37ae None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:17.172698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:17.199673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658e784-7c97-4444-875f-b252e91f42e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:17.200296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658e784-7c97-4444-875f-b252e91f42e1 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:17.200561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658e784-7c97-4444-875f-b252e91f42e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:17.200824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658e784-7c97-4444-875f-b252e91f42e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:17.202570 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3658e784-7c97-4444-875f-b252e91f42e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:17.299159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658e784-7c97-4444-875f-b252e91f42e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:17.300774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658e784-7c97-4444-875f-b252e91f42e1 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:17.320159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 712/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:18.384078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75720ff-ab8a-4360-9c12-0c7b4f93a91f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:18.384693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75720ff-ab8a-4360-9c12-0c7b4f93a91f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:18.384693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75720ff-ab8a-4360-9c12-0c7b4f93a91f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:18.385975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:18.392646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcffa5d-d1ec-4d38-be89-5e3e1b6625b5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:18.393128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcffa5d-d1ec-4d38-be89-5e3e1b6625b5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:18.393243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcffa5d-d1ec-4d38-be89-5e3e1b6625b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:18.470571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cdcffa5d-d1ec-4d38-be89-5e3e1b6625b5 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:18.471819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cdcffa5d-d1ec-4d38-be89-5e3e1b6625b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:18.515428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:18.572938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:18.721783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75720ff-ab8a-4360-9c12-0c7b4f93a91f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:18.723336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f75720ff-ab8a-4360-9c12-0c7b4f93a91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:18.879157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75720ff-ab8a-4360-9c12-0c7b4f93a91f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:18.938856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:19.003971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4d040-e59e-4253-bb32-f9561e91998f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:19.004832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4d040-e59e-4253-bb32-f9561e91998f service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:19.005246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4d040-e59e-4253-bb32-f9561e91998f service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:19.005627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4d040-e59e-4253-bb32-f9561e91998f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:19.008160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-77e4d040-e59e-4253-bb32-f9561e91998f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:19.109684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4d040-e59e-4253-bb32-f9561e91998f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:19.111323 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4d040-e59e-4253-bb32-f9561e91998f service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:19.132258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 724/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:20.192864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6ac2b-e9f5-4965-a815-3e088cfb10ec None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:20.193450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6ac2b-e9f5-4965-a815-3e088cfb10ec None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:20.193450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6ac2b-e9f5-4965-a815-3e088cfb10ec None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:20.194779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:20.202295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8778dbc-b0ed-4ebe-843d-ae980c81ccd1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:20.203202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8778dbc-b0ed-4ebe-843d-ae980c81ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:20.203683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8778dbc-b0ed-4ebe-843d-ae980c81ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:20.290834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d8778dbc-b0ed-4ebe-843d-ae980c81ccd1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:20.292061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d8778dbc-b0ed-4ebe-843d-ae980c81ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:20.294090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:20.403938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:20.556018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6ac2b-e9f5-4965-a815-3e088cfb10ec None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:20.558271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-92c6ac2b-e9f5-4965-a815-3e088cfb10ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:20.712898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6ac2b-e9f5-4965-a815-3e088cfb10ec None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:20.741171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:20.831581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb847f-5068-429a-ab82-1cc9367bae9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:20.832107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb847f-5068-429a-ab82-1cc9367bae9b service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:20.832382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb847f-5068-429a-ab82-1cc9367bae9b service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:20.832649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb847f-5068-429a-ab82-1cc9367bae9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:20.834250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6bdb847f-5068-429a-ab82-1cc9367bae9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:20.930422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb847f-5068-429a-ab82-1cc9367bae9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:20.932043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb847f-5068-429a-ab82-1cc9367bae9b service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:20.960028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 715/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:22.987803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016a108-bd47-405a-89c4-b2ddd8c55030 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:22.988462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016a108-bd47-405a-89c4-b2ddd8c55030 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:22.988565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016a108-bd47-405a-89c4-b2ddd8c55030 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:22.990525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:22.997047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5be20-f841-442f-9036-fdb48390d3f8 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:22.997537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5be20-f841-442f-9036-fdb48390d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:22.997642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5be20-f841-442f-9036-fdb48390d3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:23.039266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:23.067249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-47d5be20-f841-442f-9036-fdb48390d3f8 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:23.068540 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-47d5be20-f841-442f-9036-fdb48390d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:23.173752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:23.462817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016a108-bd47-405a-89c4-b2ddd8c55030 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:23.465356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5016a108-bd47-405a-89c4-b2ddd8c55030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:23.587913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016a108-bd47-405a-89c4-b2ddd8c55030 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:23.622745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:23.665757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e4f2-cd04-48b7-8bed-d5c31e96780d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:23.666345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e4f2-cd04-48b7-8bed-d5c31e96780d service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:23.666620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e4f2-cd04-48b7-8bed-d5c31e96780d service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:23.666887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e4f2-cd04-48b7-8bed-d5c31e96780d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:23.668532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d813e4f2-cd04-48b7-8bed-d5c31e96780d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:23.792017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813e4f2-cd04-48b7-8bed-d5c31e96780d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:23.793456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813e4f2-cd04-48b7-8bed-d5c31e96780d service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:23.812360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 727/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:26.131936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972aed6-2f21-4ed6-a3a8-13b6f1e56047 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:26.132738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972aed6-2f21-4ed6-a3a8-13b6f1e56047 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:26.132738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972aed6-2f21-4ed6-a3a8-13b6f1e56047 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:26.134760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:26.141023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b2ff5-bc9f-4b28-9ce7-df4f337c94bf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:26.141620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b2ff5-bc9f-4b28-9ce7-df4f337c94bf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:26.141620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b2ff5-bc9f-4b28-9ce7-df4f337c94bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:26.209013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-567b2ff5-bc9f-4b28-9ce7-df4f337c94bf None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:26.210216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-567b2ff5-bc9f-4b28-9ce7-df4f337c94bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:26.223613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:26.313014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:26.598885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972aed6-2f21-4ed6-a3a8-13b6f1e56047 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:26.601449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7972aed6-2f21-4ed6-a3a8-13b6f1e56047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:26.717078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972aed6-2f21-4ed6-a3a8-13b6f1e56047 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:26.730501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:26.796929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1baf2-f487-4eee-9d8b-f50e956ebb92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:26.797538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1baf2-f487-4eee-9d8b-f50e956ebb92 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:26.797811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1baf2-f487-4eee-9d8b-f50e956ebb92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:26.798076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1baf2-f487-4eee-9d8b-f50e956ebb92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:26.799762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-12f1baf2-f487-4eee-9d8b-f50e956ebb92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:26.918281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1baf2-f487-4eee-9d8b-f50e956ebb92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:26.919685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1baf2-f487-4eee-9d8b-f50e956ebb92 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:26.938247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 718/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:29.371828 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc0a4-0e67-41eb-9712-6761253c8877 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:29.372397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc0a4-0e67-41eb-9712-6761253c8877 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:29.372397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc0a4-0e67-41eb-9712-6761253c8877 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:29.373738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:29.379288 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fb4e2-61ea-4449-bac4-2d4cc045a311 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:29.379776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fb4e2-61ea-4449-bac4-2d4cc045a311 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:29.379889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fb4e2-61ea-4449-bac4-2d4cc045a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:29.430794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:29.448906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-dc0fb4e2-61ea-4449-bac4-2d4cc045a311 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:29.450154 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-dc0fb4e2-61ea-4449-bac4-2d4cc045a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:29.557795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:29.843675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bc0a4-0e67-41eb-9712-6761253c8877 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:29.845218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9b5bc0a4-0e67-41eb-9712-6761253c8877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:29.953879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bc0a4-0e67-41eb-9712-6761253c8877 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:29.998503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:30.045440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412a66d-d177-46e3-b987-304978e69e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:30.046053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a66d-d177-46e3-b987-304978e69e0e service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:30.046329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a66d-d177-46e3-b987-304978e69e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:30.046601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a66d-d177-46e3-b987-304978e69e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:30.048234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d412a66d-d177-46e3-b987-304978e69e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:30.160500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412a66d-d177-46e3-b987-304978e69e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:30.161938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412a66d-d177-46e3-b987-304978e69e0e service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:30.181847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 730/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:32.490955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c6469-43f4-41a2-a348-9779df2f0ef3 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:32.491895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c6469-43f4-41a2-a348-9779df2f0ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:32.491895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c6469-43f4-41a2-a348-9779df2f0ef3 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:32.494290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:32.499926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbdd27-cb90-4564-b2cb-79a7bceb65b6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:32.500366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbdd27-cb90-4564-b2cb-79a7bceb65b6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:32.500467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbdd27-cb90-4564-b2cb-79a7bceb65b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:32.569428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2bbbdd27-cb90-4564-b2cb-79a7bceb65b6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:32.570556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2bbbdd27-cb90-4564-b2cb-79a7bceb65b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:32.591822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:32.671216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:32.962507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c6469-43f4-41a2-a348-9779df2f0ef3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:32.965086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c75c6469-43f4-41a2-a348-9779df2f0ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:33.087179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c6469-43f4-41a2-a348-9779df2f0ef3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:33.108926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:33.165077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898c7a6-26dc-427f-9e44-dc6da080eb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:33.165718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898c7a6-26dc-427f-9e44-dc6da080eb31 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:33.165991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898c7a6-26dc-427f-9e44-dc6da080eb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:33.166262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898c7a6-26dc-427f-9e44-dc6da080eb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:33.167928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f898c7a6-26dc-427f-9e44-dc6da080eb31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:33.284455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898c7a6-26dc-427f-9e44-dc6da080eb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:33.285835 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898c7a6-26dc-427f-9e44-dc6da080eb31 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:33.305305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 721/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:35.566524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825029f1-6439-49a5-a130-9fe78f4eeb06 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:35.567189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825029f1-6439-49a5-a130-9fe78f4eeb06 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:35.567189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825029f1-6439-49a5-a130-9fe78f4eeb06 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:35.568461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:35.574872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6f9be-7bcf-435d-bf85-ce12e4c4204d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:35.575345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6f9be-7bcf-435d-bf85-ce12e4c4204d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:35.575472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6f9be-7bcf-435d-bf85-ce12e4c4204d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:35.644272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:35.648504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-87d6f9be-7bcf-435d-bf85-ce12e4c4204d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:35.651209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-87d6f9be-7bcf-435d-bf85-ce12e4c4204d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:35.757961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:36.041978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825029f1-6439-49a5-a130-9fe78f4eeb06 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:36.044547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-825029f1-6439-49a5-a130-9fe78f4eeb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:36.160462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825029f1-6439-49a5-a130-9fe78f4eeb06 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:36.213938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:36.240314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25a751-6d46-4761-8ce3-a40b56a0b837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:36.240930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25a751-6d46-4761-8ce3-a40b56a0b837 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:36.241206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25a751-6d46-4761-8ce3-a40b56a0b837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:36.241472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25a751-6d46-4761-8ce3-a40b56a0b837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:36.243078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1c25a751-6d46-4761-8ce3-a40b56a0b837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:36.361376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25a751-6d46-4761-8ce3-a40b56a0b837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:36.362817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25a751-6d46-4761-8ce3-a40b56a0b837 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:36.382070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 733/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:38.570081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4d80-7eee-42fd-913c-61e21068c21a None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:38.570628 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4d80-7eee-42fd-913c-61e21068c21a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:38.570628 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4d80-7eee-42fd-913c-61e21068c21a None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:38.571897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:38.578507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65685c0b-ee76-4773-b2cb-be0b6d14752b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:38.578968 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65685c0b-ee76-4773-b2cb-be0b6d14752b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:38.579076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65685c0b-ee76-4773-b2cb-be0b6d14752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:38.659205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-65685c0b-ee76-4773-b2cb-be0b6d14752b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:38.660435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-65685c0b-ee76-4773-b2cb-be0b6d14752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:38.697471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:38.766560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:39.064215 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4d80-7eee-42fd-913c-61e21068c21a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:39.065755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c66f4d80-7eee-42fd-913c-61e21068c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:39.172783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4d80-7eee-42fd-913c-61e21068c21a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:39.204155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:39.251350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64511a74-7d24-4c07-9ea6-355ad4595630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:39.251947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64511a74-7d24-4c07-9ea6-355ad4595630 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:39.252213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64511a74-7d24-4c07-9ea6-355ad4595630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:39.252477 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64511a74-7d24-4c07-9ea6-355ad4595630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:39.254067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-64511a74-7d24-4c07-9ea6-355ad4595630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:39.364845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64511a74-7d24-4c07-9ea6-355ad4595630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:39.366291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64511a74-7d24-4c07-9ea6-355ad4595630 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:39.384754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 724/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:41.664557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba216f-1445-43cd-9dd0-f8e3aa2d6596 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:41.665104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba216f-1445-43cd-9dd0-f8e3aa2d6596 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:41.665104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba216f-1445-43cd-9dd0-f8e3aa2d6596 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:41.666359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:41.673166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fbf42-bd27-443a-ae50-8c5f7d75d64f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:41.673937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fbf42-bd27-443a-ae50-8c5f7d75d64f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:41.674096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fbf42-bd27-443a-ae50-8c5f7d75d64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:41.754469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-299fbf42-bd27-443a-ae50-8c5f7d75d64f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:41.755735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-299fbf42-bd27-443a-ae50-8c5f7d75d64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:41.765084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:41.864399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:42.153886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba216f-1445-43cd-9dd0-f8e3aa2d6596 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:42.155671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-58ba216f-1445-43cd-9dd0-f8e3aa2d6596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:42.269440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba216f-1445-43cd-9dd0-f8e3aa2d6596 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:42.327989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:42.347277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854651c0-6004-4d3e-a315-a9936c0c1548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:42.347914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854651c0-6004-4d3e-a315-a9936c0c1548 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:42.348185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854651c0-6004-4d3e-a315-a9936c0c1548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:42.348456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854651c0-6004-4d3e-a315-a9936c0c1548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:42.350073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-854651c0-6004-4d3e-a315-a9936c0c1548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:42.593106 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854651c0-6004-4d3e-a315-a9936c0c1548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:42.594546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854651c0-6004-4d3e-a315-a9936c0c1548 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:42.615787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 736/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:44.794795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942bb44-4cf8-4f73-b466-3780e2fa7232 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:44.795872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942bb44-4cf8-4f73-b466-3780e2fa7232 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:44.795872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942bb44-4cf8-4f73-b466-3780e2fa7232 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:44.798181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:44.807115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae137c4-7696-4971-8363-a7b6fe06f31e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:44.807600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae137c4-7696-4971-8363-a7b6fe06f31e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:44.807697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae137c4-7696-4971-8363-a7b6fe06f31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:44.883527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aae137c4-7696-4971-8363-a7b6fe06f31e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:44.884727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aae137c4-7696-4971-8363-a7b6fe06f31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:44.923190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:44.986677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:45.267517 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942bb44-4cf8-4f73-b466-3780e2fa7232 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:45.269907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4942bb44-4cf8-4f73-b466-3780e2fa7232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:45.395476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942bb44-4cf8-4f73-b466-3780e2fa7232 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:45.440344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:45.481435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af454fe-f48f-42c8-88af-4ddcc46f1ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:45.482041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af454fe-f48f-42c8-88af-4ddcc46f1ecd service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:45.482313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af454fe-f48f-42c8-88af-4ddcc46f1ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:45.482659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af454fe-f48f-42c8-88af-4ddcc46f1ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:45.484301 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8af454fe-f48f-42c8-88af-4ddcc46f1ecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:45.601068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af454fe-f48f-42c8-88af-4ddcc46f1ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:45.603123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af454fe-f48f-42c8-88af-4ddcc46f1ecd service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:45.628877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 727/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:47.770805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa565-6f0f-4566-88f6-f47ff9f1c912 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:47.771424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa565-6f0f-4566-88f6-f47ff9f1c912 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:47.771424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa565-6f0f-4566-88f6-f47ff9f1c912 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:47.772723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 04:26:47.779648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ec48-d9a6-4a02-8cfe-aa02fbee355f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:47.780100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ec48-d9a6-4a02-8cfe-aa02fbee355f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:47.780206 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ec48-d9a6-4a02-8cfe-aa02fbee355f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:47.849399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-36b1ec48-d9a6-4a02-8cfe-aa02fbee355f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:47.850598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-36b1ec48-d9a6-4a02-8cfe-aa02fbee355f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:47.868939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:47.951375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:48.234282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aa565-6f0f-4566-88f6-f47ff9f1c912 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:48.235863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-778aa565-6f0f-4566-88f6-f47ff9f1c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:48.346594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aa565-6f0f-4566-88f6-f47ff9f1c912 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:48.428784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:48.436066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022f16b-defd-4ee8-96be-4f9dfe984e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:48.436672 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022f16b-defd-4ee8-96be-4f9dfe984e2b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:48.437071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022f16b-defd-4ee8-96be-4f9dfe984e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:48.437346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022f16b-defd-4ee8-96be-4f9dfe984e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:48.438977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f022f16b-defd-4ee8-96be-4f9dfe984e2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:48.570880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022f16b-defd-4ee8-96be-4f9dfe984e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:48.572287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022f16b-defd-4ee8-96be-4f9dfe984e2b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:48.591224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 739/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:50.783638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb391-36dc-41ab-b1b6-59e5ade25c46 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:50.784209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb391-36dc-41ab-b1b6-59e5ade25c46 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:50.784209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb391-36dc-41ab-b1b6-59e5ade25c46 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:50.785559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:26:50.792123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ca6d4-a0fa-4391-9e12-6f9ac5709f55 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:50.792877 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ca6d4-a0fa-4391-9e12-6f9ac5709f55 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:50.793018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ca6d4-a0fa-4391-9e12-6f9ac5709f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:50.869645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6c6ca6d4-a0fa-4391-9e12-6f9ac5709f55 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:26:50.870842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6c6ca6d4-a0fa-4391-9e12-6f9ac5709f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:50.921172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:50.977456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:26:51.272331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb391-36dc-41ab-b1b6-59e5ade25c46 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:26:51.273876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e33cb391-36dc-41ab-b1b6-59e5ade25c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:51.389532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb391-36dc-41ab-b1b6-59e5ade25c46 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:26:51.440649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:51.470217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab288-efa6-408f-a82a-26181ee5c9aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:26:51.470818 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab288-efa6-408f-a82a-26181ee5c9aa service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:26:51.471091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab288-efa6-408f-a82a-26181ee5c9aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:26:51.471380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab288-efa6-408f-a82a-26181ee5c9aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:26:51.472991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4acab288-efa6-408f-a82a-26181ee5c9aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:26:51.589286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acab288-efa6-408f-a82a-26181ee5c9aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:26:51.591487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acab288-efa6-408f-a82a-26181ee5c9aa service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:26:51.610928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 730/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:27:00.975870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=22 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:01.608411 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=66 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:11.491216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f6988-b76e-4eb5-b05e-9cbd9a52b7ad None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:11.491811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f6988-b76e-4eb5-b05e-9cbd9a52b7ad None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:11.491811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f6988-b76e-4eb5-b05e-9cbd9a52b7ad None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:11.493176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 741/1471] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:27:11.499700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e57c07-9a6d-4147-9dea-71767fc3e676 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:11.500435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e57c07-9a6d-4147-9dea-71767fc3e676 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:11.500721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e57c07-9a6d-4147-9dea-71767fc3e676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:11.586868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-52e57c07-9a6d-4147-9dea-71767fc3e676 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:27:11.588160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-52e57c07-9a6d-4147-9dea-71767fc3e676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:11.700954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 731/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:27:12.000854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770d444-f685-458e-abf5-4e9418b84c72 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:12.001130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770d444-f685-458e-abf5-4e9418b84c72 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:12.001397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770d444-f685-458e-abf5-4e9418b84c72 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:12.002740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 742/1473] 10.222.0.20 () {54 vars in 962 bytes} [Thu Oct 6 04:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:27:12.007874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf577ac-9716-455d-8803-f0c04cba58a2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:12.008156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf577ac-9716-455d-8803-f0c04cba58a2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:12.008427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf577ac-9716-455d-8803-f0c04cba58a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:12.085338 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-edf577ac-9716-455d-8803-f0c04cba58a2 None None] MFA Rules not processed for user `457880195ed849d2b594ddea6acdf7df`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:27:12.086541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-edf577ac-9716-455d-8803-f0c04cba58a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:12.108727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:12.170491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 732/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Oct 6 04:27:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:27:12.179144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770d444-f685-458e-abf5-4e9418b84c72 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:27:12.181579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5770d444-f685-458e-abf5-4e9418b84c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:12.297260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770d444-f685-458e-abf5-4e9418b84c72 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:27:12.385876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f79025-dc96-4dd5-afdd-7078a08386a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '457880195ed849d2b594ddea6acdf7df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:27:12.386486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f79025-dc96-4dd5-afdd-7078a08386a8 service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:12.386758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f79025-dc96-4dd5-afdd-7078a08386a8 service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:12.387010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f79025-dc96-4dd5-afdd-7078a08386a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:12.388647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-66f79025-dc96-4dd5-afdd-7078a08386a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:12.446032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:12.510341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f79025-dc96-4dd5-afdd-7078a08386a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:27:12.511812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f79025-dc96-4dd5-afdd-7078a08386a8 service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:27:12.531471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 743/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:27:14.735083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689b26-70ea-48b6-9c24-6653abb6f238 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:14.736213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689b26-70ea-48b6-9c24-6653abb6f238 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:14.736213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689b26-70ea-48b6-9c24-6653abb6f238 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:14.738191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 733/1476] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:27:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:27:14.747573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dae41-77c2-4f96-a07d-5e4e24f14d63 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:14.748008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dae41-77c2-4f96-a07d-5e4e24f14d63 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:14.748115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dae41-77c2-4f96-a07d-5e4e24f14d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:14.822691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d05dae41-77c2-4f96-a07d-5e4e24f14d63 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:27:14.823919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d05dae41-77c2-4f96-a07d-5e4e24f14d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:14.934047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 744/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:27:15.217848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49689b26-70ea-48b6-9c24-6653abb6f238 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:27:15.220292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-49689b26-70ea-48b6-9c24-6653abb6f238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:15.372435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49689b26-70ea-48b6-9c24-6653abb6f238 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:27:15.423919 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:15.469029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939ceeb-1a63-4f66-a9b9-010f435fe303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:27:15.469561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ceeb-1a63-4f66-a9b9-010f435fe303 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:15.469826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ceeb-1a63-4f66-a9b9-010f435fe303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:15.470090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ceeb-1a63-4f66-a9b9-010f435fe303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:15.470722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939ceeb-1a63-4f66-a9b9-010f435fe303 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:27:15.472493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-9939ceeb-1a63-4f66-a9b9-010f435fe303 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:27:15.472493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: warnings.warn(msg) Oct 06 04:27:15.472493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: Oct 06 04:27:15.473607 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939ceeb-1a63-4f66-a9b9-010f435fe303 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:27:15.494337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 734/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Oct 6 04:27:15 2022] GET /identity/v3/projects => generated 2553 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:27:17.717615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0bac5-a5d3-4180-a3e0-317c7729776f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:17.718185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0bac5-a5d3-4180-a3e0-317c7729776f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:17.718185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0bac5-a5d3-4180-a3e0-317c7729776f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:17.720187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 745/1479] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:27:17.729348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a429d-8193-457f-b2ac-40ba02ff25a6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:17.730157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a429d-8193-457f-b2ac-40ba02ff25a6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:17.730157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a429d-8193-457f-b2ac-40ba02ff25a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:17.806790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-601a429d-8193-457f-b2ac-40ba02ff25a6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:27:17.808034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-601a429d-8193-457f-b2ac-40ba02ff25a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:17.908555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 735/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:27:18.213615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0bac5-a5d3-4180-a3e0-317c7729776f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:27:18.215276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-55e0bac5-a5d3-4180-a3e0-317c7729776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:18.226320 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:18.371902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0bac5-a5d3-4180-a3e0-317c7729776f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:27:18.465742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:18.502872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f9ee-13c0-4cbd-9330-0b07102dfd64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:27:18.503524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f9ee-13c0-4cbd-9330-0b07102dfd64 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:18.503800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f9ee-13c0-4cbd-9330-0b07102dfd64 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:18.504069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f9ee-13c0-4cbd-9330-0b07102dfd64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:18.505746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b682f9ee-13c0-4cbd-9330-0b07102dfd64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:18.603572 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682f9ee-13c0-4cbd-9330-0b07102dfd64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:27:18.605162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682f9ee-13c0-4cbd-9330-0b07102dfd64 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:27:18.624072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 746/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:27:20.966539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bf2df-1444-46de-908c-ff6df80e4440 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:20.967508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bf2df-1444-46de-908c-ff6df80e4440 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:20.967508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bf2df-1444-46de-908c-ff6df80e4440 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:20.969704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 736/1482] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:27:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:27:20.975241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81609461-67fb-4339-aea0-34602dfd8b32 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:20.975720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81609461-67fb-4339-aea0-34602dfd8b32 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:20.975829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81609461-67fb-4339-aea0-34602dfd8b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:21.043624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-81609461-67fb-4339-aea0-34602dfd8b32 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:27:21.044887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-81609461-67fb-4339-aea0-34602dfd8b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:21.095754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:21.146416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 747/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:27:21.437648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bf2df-1444-46de-908c-ff6df80e4440 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:27:21.440013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-801bf2df-1444-46de-908c-ff6df80e4440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:21.467822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:21.560285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bf2df-1444-46de-908c-ff6df80e4440 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:27:21.653436 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc111367-ef68-4c0e-9501-d8e78c3acc77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:27:21.653961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111367-ef68-4c0e-9501-d8e78c3acc77 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:21.654229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111367-ef68-4c0e-9501-d8e78c3acc77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:21.654492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111367-ef68-4c0e-9501-d8e78c3acc77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:21.656124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cc111367-ef68-4c0e-9501-d8e78c3acc77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:21.738566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:21.777569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc111367-ef68-4c0e-9501-d8e78c3acc77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:27:21.779015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc111367-ef68-4c0e-9501-d8e78c3acc77 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:27:21.801898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 737/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:27:24.019956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956071d-e37f-43a5-8f46-86ec5efc68bf None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:24.020749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956071d-e37f-43a5-8f46-86ec5efc68bf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:24.020749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956071d-e37f-43a5-8f46-86ec5efc68bf None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:24.022962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 748/1485] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:27:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:27:24.031768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc625f7-c87c-4227-9aa9-ceed4945a1d5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:24.032548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc625f7-c87c-4227-9aa9-ceed4945a1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:24.032716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc625f7-c87c-4227-9aa9-ceed4945a1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:24.106306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7cc625f7-c87c-4227-9aa9-ceed4945a1d5 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:27:24.107553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7cc625f7-c87c-4227-9aa9-ceed4945a1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:24.215988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 738/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:27:24.509906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956071d-e37f-43a5-8f46-86ec5efc68bf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:27:24.512360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f956071d-e37f-43a5-8f46-86ec5efc68bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:24.633231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956071d-e37f-43a5-8f46-86ec5efc68bf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:27:24.708490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:24.709973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e0f62-af98-4da6-a6c6-aaf8821b4a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:27:24.710581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0f62-af98-4da6-a6c6-aaf8821b4a84 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:24.710854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0f62-af98-4da6-a6c6-aaf8821b4a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:24.711115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0f62-af98-4da6-a6c6-aaf8821b4a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:24.713685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-877e0f62-af98-4da6-a6c6-aaf8821b4a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:24.830302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e0f62-af98-4da6-a6c6-aaf8821b4a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:27:24.832394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e0f62-af98-4da6-a6c6-aaf8821b4a84 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:27:24.852457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 749/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:27:27.094809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110fbf7-948b-4585-8c8c-69705fd248a0 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:27.095595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110fbf7-948b-4585-8c8c-69705fd248a0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:27.095595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110fbf7-948b-4585-8c8c-69705fd248a0 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:27.096755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 739/1488] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:27:27.103226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fe262-cbdb-4303-8e4d-c32f5420b062 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:27.103679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fe262-cbdb-4303-8e4d-c32f5420b062 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:27.103778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fe262-cbdb-4303-8e4d-c32f5420b062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:27.174562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-700fe262-cbdb-4303-8e4d-c32f5420b062 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:27:27.175795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-700fe262-cbdb-4303-8e4d-c32f5420b062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:27.231385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:27.276977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 750/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:27:27.565231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110fbf7-948b-4585-8c8c-69705fd248a0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:27:27.566776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4110fbf7-948b-4585-8c8c-69705fd248a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:27.607795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:27.686947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110fbf7-948b-4585-8c8c-69705fd248a0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:27:27.766756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e518e5-e00a-4a94-aca9-b3f7c05ea621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:27:27.767495 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e518e5-e00a-4a94-aca9-b3f7c05ea621 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:27.767770 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e518e5-e00a-4a94-aca9-b3f7c05ea621 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:27.768039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e518e5-e00a-4a94-aca9-b3f7c05ea621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:27.769680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e0e518e5-e00a-4a94-aca9-b3f7c05ea621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:27.860847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:27.892349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e518e5-e00a-4a94-aca9-b3f7c05ea621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:27:27.893861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e518e5-e00a-4a94-aca9-b3f7c05ea621 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:27:27.914230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 740/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:27:30.302127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4183d-fc84-434c-921a-f3f1ab84ab5f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:30.303097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4183d-fc84-434c-921a-f3f1ab84ab5f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:30.303097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4183d-fc84-434c-921a-f3f1ab84ab5f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:30.305190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 751/1491] 10.222.0.20 () {54 vars in 927 bytes} [Thu Oct 6 04:27:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:27:30.311878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b891a8-0b7c-4c47-9927-1a85eb1840ef None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:30.312349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b891a8-0b7c-4c47-9927-1a85eb1840ef None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:30.312465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b891a8-0b7c-4c47-9927-1a85eb1840ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:30.388692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-95b891a8-0b7c-4c47-9927-1a85eb1840ef None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:27:30.389903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-95b891a8-0b7c-4c47-9927-1a85eb1840ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:30.490046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 741/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Oct 6 04:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:27:30.783371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4183d-fc84-434c-921a-f3f1ab84ab5f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:27:30.786087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eda4183d-fc84-434c-921a-f3f1ab84ab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:30.905960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4183d-fc84-434c-921a-f3f1ab84ab5f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:27:30.985895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea12a96-fe5e-4dee-b98c-c4c7142a9d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:27:30.986592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12a96-fe5e-4dee-b98c-c4c7142a9d5c service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:27:30.986937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12a96-fe5e-4dee-b98c-c4c7142a9d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:27:30.987202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12a96-fe5e-4dee-b98c-c4c7142a9d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:27:30.988844 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0ea12a96-fe5e-4dee-b98c-c4c7142a9d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:27:30.998422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:31.108229 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea12a96-fe5e-4dee-b98c-c4c7142a9d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:27:31.110436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea12a96-fe5e-4dee-b98c-c4c7142a9d5c service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:27:31.130831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 752/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:27:40.488196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=82 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:41.128361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=50 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:46.037420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134a05-7bd4-494b-9f32-72cbbd2648d2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:46.038027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134a05-7bd4-494b-9f32-72cbbd2648d2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:46.038027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134a05-7bd4-494b-9f32-72cbbd2648d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:46.120470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b1134a05-7bd4-494b-9f32-72cbbd2648d2 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:28:46.121676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b1134a05-7bd4-494b-9f32-72cbbd2648d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:46.219490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 742/1494] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:28:46.227775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25514a0-db94-4f1b-9f27-9a987152f637 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:46.228345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25514a0-db94-4f1b-9f27-9a987152f637 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:46.228345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25514a0-db94-4f1b-9f27-9a987152f637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:46.304574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c25514a0-db94-4f1b-9f27-9a987152f637 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:28:46.305692 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c25514a0-db94-4f1b-9f27-9a987152f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:46.413774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 753/1495] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:28:46.418794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1134a05-7bd4-494b-9f32-72cbbd2648d2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:28:46.420072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b1134a05-7bd4-494b-9f32-72cbbd2648d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:46.431870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1134a05-7bd4-494b-9f32-72cbbd2648d2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:28:46.502802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:46.538736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:28:46.539343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:46.539642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:46.539907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:46.540546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:28:46.540868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:28:46.541893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:28:46.541893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: warnings.warn(msg) Oct 06 04:28:46.541893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: Oct 06 04:28:46.542773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:28:46.556093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 743/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:28:46.568376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25514a0-db94-4f1b-9f27-9a987152f637 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:28:46.578308 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25514a0-db94-4f1b-9f27-9a987152f637 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:28:46.642355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:46.677908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17380e-e824-4c8c-b3e2-5cf0b4f8e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:28:46.678515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17380e-e824-4c8c-b3e2-5cf0b4f8e055 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:46.678781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17380e-e824-4c8c-b3e2-5cf0b4f8e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:46.679041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17380e-e824-4c8c-b3e2-5cf0b4f8e055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:46.679699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17380e-e824-4c8c-b3e2-5cf0b4f8e055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:28:46.681431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-9a17380e-e824-4c8c-b3e2-5cf0b4f8e055 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:28:46.681431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: warnings.warn(msg) Oct 06 04:28:46.681431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: Oct 06 04:28:46.682603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17380e-e824-4c8c-b3e2-5cf0b4f8e055 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:28:46.762443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 754/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:28:46 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:28:46.767023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:28:46.768843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:46.805400 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b4ac4-8b6d-4d7b-aca9-41886c5aaad8 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:28:46.902112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435b2c9-fa5d-4e98-93fe-a8dd8266d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:28:46.902639 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435b2c9-fa5d-4e98-93fe-a8dd8266d114 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:46.902911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435b2c9-fa5d-4e98-93fe-a8dd8266d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:46.903174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435b2c9-fa5d-4e98-93fe-a8dd8266d114 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:46.903823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435b2c9-fa5d-4e98-93fe-a8dd8266d114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:28:46.904849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-9435b2c9-fa5d-4e98-93fe-a8dd8266d114 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:28:46.904849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: warnings.warn(msg) Oct 06 04:28:46.904849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: Oct 06 04:28:46.906034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435b2c9-fa5d-4e98-93fe-a8dd8266d114 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:28:46.960913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 744/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:28:46 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:28:46.965452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17380e-e824-4c8c-b3e2-5cf0b4f8e055 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:28:46.966970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9a17380e-e824-4c8c-b3e2-5cf0b4f8e055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:47.041929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17380e-e824-4c8c-b3e2-5cf0b4f8e055 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:28:47.131792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:47.144737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66accd10-a5f1-499b-bb6d-18a985d8ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:28:47.145350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66accd10-a5f1-499b-bb6d-18a985d8ee70 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:47.145624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66accd10-a5f1-499b-bb6d-18a985d8ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:47.145912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66accd10-a5f1-499b-bb6d-18a985d8ee70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:47.146545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66accd10-a5f1-499b-bb6d-18a985d8ee70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:28:47.147589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-66accd10-a5f1-499b-bb6d-18a985d8ee70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:28:47.147589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: warnings.warn(msg) Oct 06 04:28:47.147589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: Oct 06 04:28:47.148477 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66accd10-a5f1-499b-bb6d-18a985d8ee70 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:28:47.161058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 755/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:28:47.165426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435b2c9-fa5d-4e98-93fe-a8dd8266d114 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:28:47.166949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9435b2c9-fa5d-4e98-93fe-a8dd8266d114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:47.178662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435b2c9-fa5d-4e98-93fe-a8dd8266d114 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:28:47.203653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:47.277793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f06d8-a3c3-457f-94e6-8130ff4e9805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:28:47.278404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f06d8-a3c3-457f-94e6-8130ff4e9805 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:47.278673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f06d8-a3c3-457f-94e6-8130ff4e9805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:47.278938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f06d8-a3c3-457f-94e6-8130ff4e9805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:47.279639 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f06d8-a3c3-457f-94e6-8130ff4e9805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:28:47.280665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-ae5f06d8-a3c3-457f-94e6-8130ff4e9805 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:28:47.280665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: warnings.warn(msg) Oct 06 04:28:47.280665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: Oct 06 04:28:47.281539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f06d8-a3c3-457f-94e6-8130ff4e9805 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:28:47.294501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 745/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:28:47.298993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66accd10-a5f1-499b-bb6d-18a985d8ee70 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:28:47.300682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-66accd10-a5f1-499b-bb6d-18a985d8ee70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:47.337227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66accd10-a5f1-499b-bb6d-18a985d8ee70 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:28:47.443658 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e7956-0108-4aad-a41a-a473d1902825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:28:47.444331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7956-0108-4aad-a41a-a473d1902825 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:47.444611 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7956-0108-4aad-a41a-a473d1902825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:47.444967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7956-0108-4aad-a41a-a473d1902825 admin admin] PATH_INFO: `/v3/projects/c094435ce25d49a3b3050f02f89cff9a/users/57779d59bce145619741a5f988ebf8c0/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:47.469587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e7956-0108-4aad-a41a-a473d1902825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c094435ce25d49a3b3050f02f89cff9a, user_id=57779d59bce145619741a5f988ebf8c0, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:28:47.470622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-7f8e7956-0108-4aad-a41a-a473d1902825 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:28:47.470622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: warnings.warn(msg) Oct 06 04:28:47.470622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: Oct 06 04:28:47.472655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e7956-0108-4aad-a41a-a473d1902825 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:28:47.501055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 756/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:28:47 2022] PUT /identity/v3/projects/c094435ce25d49a3b3050f02f89cff9a/users/57779d59bce145619741a5f988ebf8c0/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:28:47.513552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd3fa1-f7ff-4bd9-8b18-4d618de11141 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:47.513803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd3fa1-f7ff-4bd9-8b18-4d618de11141 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:47.514092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd3fa1-f7ff-4bd9-8b18-4d618de11141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:47.573055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-31dd3fa1-f7ff-4bd9-8b18-4d618de11141 None None] MFA Rules not processed for user `57779d59bce145619741a5f988ebf8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:28:47.574271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-31dd3fa1-f7ff-4bd9-8b18-4d618de11141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:47.654194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 746/1502] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:28:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:28:47.668093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e09335-3127-4691-a45c-b1a2c3a9fc6f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:47.668378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e09335-3127-4691-a45c-b1a2c3a9fc6f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:47.668648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e09335-3127-4691-a45c-b1a2c3a9fc6f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:47.670034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 757/1503] 10.222.0.20 () {54 vars in 963 bytes} [Thu Oct 6 04:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:28:47.675772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77f444-ca57-4401-b6ec-f5fe39ffebad None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:47.676057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77f444-ca57-4401-b6ec-f5fe39ffebad None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:47.676327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77f444-ca57-4401-b6ec-f5fe39ffebad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:47.710247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:47.756442 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6e77f444-ca57-4401-b6ec-f5fe39ffebad None None] MFA Rules not processed for user `e66a78c94f03443cbae595bba07e458d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:28:47.757634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6e77f444-ca57-4401-b6ec-f5fe39ffebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:47.840881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 747/1504] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Oct 6 04:28:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:28:47.852289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e09335-3127-4691-a45c-b1a2c3a9fc6f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:28:47.853867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f0e09335-3127-4691-a45c-b1a2c3a9fc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:47.908074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:47.964703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e09335-3127-4691-a45c-b1a2c3a9fc6f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:28:48.038934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432923b8-9094-466b-8104-f39e6f78f57a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:28:48.039569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432923b8-9094-466b-8104-f39e6f78f57a service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:48.039846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432923b8-9094-466b-8104-f39e6f78f57a service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:48.040105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432923b8-9094-466b-8104-f39e6f78f57a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:48.041697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-432923b8-9094-466b-8104-f39e6f78f57a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:48.149794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432923b8-9094-466b-8104-f39e6f78f57a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:28:48.151190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432923b8-9094-466b-8104-f39e6f78f57a service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:28:48.154761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:48.169818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 758/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:28:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:28:48.216703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e50a-7771-48d5-8c06-f4af61f80eb5 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:48.217185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e50a-7771-48d5-8c06-f4af61f80eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:48.217185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e50a-7771-48d5-8c06-f4af61f80eb5 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:48.218407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 748/1506] 10.222.0.20 () {52 vars in 830 bytes} [Thu Oct 6 04:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:28:48.222321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432923b8-9094-466b-8104-f39e6f78f57a service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:28:48.223588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-432923b8-9094-466b-8104-f39e6f78f57a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:48.327767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432923b8-9094-466b-8104-f39e6f78f57a service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:28:48.436158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:28:48.436782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:48.437053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:48.437314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] PATH_INFO: `/v3/users/57779d59bce145619741a5f988ebf8c0` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:48.454001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57779d59bce145619741a5f988ebf8c0)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:28:48.455032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:28:48.455032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: warnings.warn(msg) Oct 06 04:28:48.455032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: Oct 06 04:28:48.456393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:28:48.466914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:48.531778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57779d59bce145619741a5f988ebf8c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:28:48.542623 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57779d59bce145619741a5f988ebf8c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:28:48.566627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57779d59bce145619741a5f988ebf8c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:28:48.567061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57779d59bce145619741a5f988ebf8c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:28:48.581331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57779d59bce145619741a5f988ebf8c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:28:48.587297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 759/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:28:48 2022] DELETE /identity/v3/users/57779d59bce145619741a5f988ebf8c0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:28:48.592049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5d686-e75d-41bb-aafa-6975a4c6630f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:48.592372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5d686-e75d-41bb-aafa-6975a4c6630f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:48.592640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5d686-e75d-41bb-aafa-6975a4c6630f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:48.650889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-64b5d686-e75d-41bb-aafa-6975a4c6630f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:28:48.652114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-64b5d686-e75d-41bb-aafa-6975a4c6630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:48.730773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:48.744562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 749/1508] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:28:48.755086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:28:48.756868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:48.876213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b972fb-a9eb-476f-8ec2-5bd62ab00e7d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:28:48.935556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:48.964395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409639dd-ba01-4162-be71-9361b0445ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:28:48.965293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409639dd-ba01-4162-be71-9361b0445ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:48.965593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409639dd-ba01-4162-be71-9361b0445ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:48.965970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409639dd-ba01-4162-be71-9361b0445ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:48.968564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-409639dd-ba01-4162-be71-9361b0445ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:49.090076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409639dd-ba01-4162-be71-9361b0445ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:28:49.091481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409639dd-ba01-4162-be71-9361b0445ab7 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:28:49.110475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 760/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:28:49.460065 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5d686-e75d-41bb-aafa-6975a4c6630f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:28:49.461386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-64b5d686-e75d-41bb-aafa-6975a4c6630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:28:49.473708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5d686-e75d-41bb-aafa-6975a4c6630f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:28:49.577605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:28:49.578537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:28:49.578902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:28:49.579259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] PATH_INFO: `/v3/projects/c094435ce25d49a3b3050f02f89cff9a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:28:49.594026 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c094435ce25d49a3b3050f02f89cff9a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:28:49.595579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:28:49.595579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: warnings.warn(msg) Oct 06 04:28:49.595579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: Oct 06 04:28:49.597590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:28:49.658566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c094435ce25d49a3b3050f02f89cff9a', 'request_id': 'req-d7a02480-f67e-403d-86b6-914c3f505cc6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:28:49.670393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c094435ce25d49a3b3050f02f89cff9a', 'request_id': 'req-d7a02480-f67e-403d-86b6-914c3f505cc6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:28:49.679482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c094435ce25d49a3b3050f02f89cff9a', 'request_id': 'req-d7a02480-f67e-403d-86b6-914c3f505cc6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:28:49.714195 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] The token cache is being invalidate because project c094435ce25d49a3b3050f02f89cff9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:28:49.714473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:28:49.714890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d7a02480-f67e-403d-86b6-914c3f505cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:28:49.716297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 750/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:28:49 2022] DELETE /identity/v3/projects/c094435ce25d49a3b3050f02f89cff9a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:28:59.108015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=62 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:28:59.712220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:30:23.980011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25728a00-3787-4a32-bebc-1483cb7ca96c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:23.980929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25728a00-3787-4a32-bebc-1483cb7ca96c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:23.980929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25728a00-3787-4a32-bebc-1483cb7ca96c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:23.983064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:30:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:30:23.990534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572293-d727-4fa9-8b69-7eb807872f4d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:23.991013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572293-d727-4fa9-8b69-7eb807872f4d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:23.991013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572293-d727-4fa9-8b69-7eb807872f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:24.074771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c0572293-d727-4fa9-8b69-7eb807872f4d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:30:24.076036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c0572293-d727-4fa9-8b69-7eb807872f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:24.194297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:30:24.357902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25728a00-3787-4a32-bebc-1483cb7ca96c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:30:24.360597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-25728a00-3787-4a32-bebc-1483cb7ca96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:24.494374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25728a00-3787-4a32-bebc-1483cb7ca96c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:30:24.501549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45db0d2-913a-485b-aaeb-a7a944572d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:30:24.502168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45db0d2-913a-485b-aaeb-a7a944572d41 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:24.502443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45db0d2-913a-485b-aaeb-a7a944572d41 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:24.502763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45db0d2-913a-485b-aaeb-a7a944572d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:24.511335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45db0d2-913a-485b-aaeb-a7a944572d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:30:24.512921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45db0d2-913a-485b-aaeb-a7a944572d41 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:30:24.522381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 762/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:30:25.611434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4b52c-91e8-41af-85e4-3825bb878e3a None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:25.612242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4b52c-91e8-41af-85e4-3825bb878e3a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:25.612242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4b52c-91e8-41af-85e4-3825bb878e3a None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:25.614513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:30:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:30:25.620923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d949-dd07-4cf4-acf9-6964d2a93249 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:25.621390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d949-dd07-4cf4-acf9-6964d2a93249 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:25.621484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d949-dd07-4cf4-acf9-6964d2a93249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:25.643456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-68f8d949-dd07-4cf4-acf9-6964d2a93249 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:30:25.644642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-68f8d949-dd07-4cf4-acf9-6964d2a93249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:25.653235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:30:25.804680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4b52c-91e8-41af-85e4-3825bb878e3a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:30:25.822173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4b52c-91e8-41af-85e4-3825bb878e3a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:30:25.828387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027b3e5-3691-4910-a72f-9744a5a938b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:30:25.828996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027b3e5-3691-4910-a72f-9744a5a938b8 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:25.829272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027b3e5-3691-4910-a72f-9744a5a938b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:25.829541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027b3e5-3691-4910-a72f-9744a5a938b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:25.837518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027b3e5-3691-4910-a72f-9744a5a938b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:30:25.839104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027b3e5-3691-4910-a72f-9744a5a938b8 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:30:25.848951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 753/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:30:26.079651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05716-cfab-4631-9e51-42da53be7a44 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:26.079886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05716-cfab-4631-9e51-42da53be7a44 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:26.080183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05716-cfab-4631-9e51-42da53be7a44 None None] PATH_INFO: `/v3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:26.081561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 764/1517] 10.222.0.16 () {54 vars in 925 bytes} [Thu Oct 6 04:30:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:30:26.088856 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc031-5a07-4f68-b3f5-0bc5ff345d7e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:26.089140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc031-5a07-4f68-b3f5-0bc5ff345d7e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:26.089408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc031-5a07-4f68-b3f5-0bc5ff345d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:26.164558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-384cc031-5a07-4f68-b3f5-0bc5ff345d7e None None] MFA Rules not processed for user `ff4e48fdc18e424fa2cf80fd5da332b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:30:26.165681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-384cc031-5a07-4f68-b3f5-0bc5ff345d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:26.189171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:30:26.261123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 754/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Oct 6 04:30:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:30:35.311520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa2e8-3b51-4b4a-b008-5727e96e2bd3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:35.312046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa2e8-3b51-4b4a-b008-5727e96e2bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:35.312147 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa2e8-3b51-4b4a-b008-5727e96e2bd3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:35.313483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 765/1519] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 6 04:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:30:35.319133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed4dd5-b925-4e81-972b-f984b8af4ad1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:35.319599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed4dd5-b925-4e81-972b-f984b8af4ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:35.319908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed4dd5-b925-4e81-972b-f984b8af4ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:35.344838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-01ed4dd5-b925-4e81-972b-f984b8af4ad1 None None] MFA Rules not processed for user `ff4e48fdc18e424fa2cf80fd5da332b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:30:35.345962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-01ed4dd5-b925-4e81-972b-f984b8af4ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:35.355128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 755/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 6 04:30:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:30:35.364459 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa2e8-3b51-4b4a-b008-5727e96e2bd3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:30:35.378348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa2e8-3b51-4b4a-b008-5727e96e2bd3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:30:35.383903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3be00-5bf3-4924-a87f-6dd0a2a95606 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:30:35.384513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3be00-5bf3-4924-a87f-6dd0a2a95606 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:35.384903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3be00-5bf3-4924-a87f-6dd0a2a95606 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:35.385305 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3be00-5bf3-4924-a87f-6dd0a2a95606 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:35.394269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3be00-5bf3-4924-a87f-6dd0a2a95606 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:30:35.395904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3be00-5bf3-4924-a87f-6dd0a2a95606 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:30:35.405756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 766/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:30:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:30:37.385078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca37a-f0a7-48a1-b9ed-2388262f40d2 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:37.385662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca37a-f0a7-48a1-b9ed-2388262f40d2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:37.385662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca37a-f0a7-48a1-b9ed-2388262f40d2 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:37.386996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:30:37.394060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de015-330b-49a2-bbdc-fd398d8db2cd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:37.394948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de015-330b-49a2-bbdc-fd398d8db2cd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:37.395219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de015-330b-49a2-bbdc-fd398d8db2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:37.416689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0a5de015-330b-49a2-bbdc-fd398d8db2cd None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:30:37.417900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0a5de015-330b-49a2-bbdc-fd398d8db2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:37.426923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:30:37.580398 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca37a-f0a7-48a1-b9ed-2388262f40d2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:30:37.596727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca37a-f0a7-48a1-b9ed-2388262f40d2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:30:37.602778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79824882-339f-4ae2-b229-3e426676b8e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:30:37.603449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79824882-339f-4ae2-b229-3e426676b8e8 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:37.603720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79824882-339f-4ae2-b229-3e426676b8e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:37.603984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79824882-339f-4ae2-b229-3e426676b8e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:37.613192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79824882-339f-4ae2-b229-3e426676b8e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:30:37.615463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79824882-339f-4ae2-b229-3e426676b8e8 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:30:37.625641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 757/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:30:38.704656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee3b4a-3d33-4563-99e2-33551b987e32 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:38.705246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee3b4a-3d33-4563-99e2-33551b987e32 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:38.705246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee3b4a-3d33-4563-99e2-33551b987e32 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:38.706889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 04:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:30:38.713522 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67333b6b-335f-4ce3-b157-661d02475fe5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:38.714034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67333b6b-335f-4ce3-b157-661d02475fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:38.714034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67333b6b-335f-4ce3-b157-661d02475fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:38.734365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-67333b6b-335f-4ce3-b157-661d02475fe5 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:30:38.735635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-67333b6b-335f-4ce3-b157-661d02475fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:38.744551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 04:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:30:38.894437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee3b4a-3d33-4563-99e2-33551b987e32 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:30:38.909343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee3b4a-3d33-4563-99e2-33551b987e32 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:30:38.915043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a93eb5-de52-4b96-b103-52a31edb15de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:30:38.915829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93eb5-de52-4b96-b103-52a31edb15de service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:38.916171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93eb5-de52-4b96-b103-52a31edb15de service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:38.916504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93eb5-de52-4b96-b103-52a31edb15de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:38.925576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a93eb5-de52-4b96-b103-52a31edb15de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:30:38.927536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a93eb5-de52-4b96-b103-52a31edb15de service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:30:38.937549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 769/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:30:42.961541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71134f9-2cd6-40e9-8904-40cdc089756b None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:42.962457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71134f9-2cd6-40e9-8904-40cdc089756b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:42.962457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71134f9-2cd6-40e9-8904-40cdc089756b None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:42.964740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:30:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:30:42.970378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f6384-6b6a-4bfb-b9ce-939956a880c8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:42.970849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f6384-6b6a-4bfb-b9ce-939956a880c8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:42.970958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f6384-6b6a-4bfb-b9ce-939956a880c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:42.992244 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8e1f6384-6b6a-4bfb-b9ce-939956a880c8 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:30:42.993450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8e1f6384-6b6a-4bfb-b9ce-939956a880c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:43.003724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:30:43.292859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71134f9-2cd6-40e9-8904-40cdc089756b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:30:43.295124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c71134f9-2cd6-40e9-8904-40cdc089756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:43.379843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71134f9-2cd6-40e9-8904-40cdc089756b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:30:43.386461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a3108-787a-4bd5-87da-440f987f9c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:30:43.387348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a3108-787a-4bd5-87da-440f987f9c5b service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:43.387796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a3108-787a-4bd5-87da-440f987f9c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:43.388260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a3108-787a-4bd5-87da-440f987f9c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:43.400325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a3108-787a-4bd5-87da-440f987f9c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:30:43.401769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a3108-787a-4bd5-87da-440f987f9c5b service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:30:43.411788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 760/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:30:45.570319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bc970-317c-43c5-a19c-ae5d55006538 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:45.570870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bc970-317c-43c5-a19c-ae5d55006538 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:45.570870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bc970-317c-43c5-a19c-ae5d55006538 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:45.572178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:30:45.578594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69efba-b30f-46c4-a285-c04db3745159 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:45.579378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69efba-b30f-46c4-a285-c04db3745159 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:45.579567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69efba-b30f-46c4-a285-c04db3745159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:45.610348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5e69efba-b30f-46c4-a285-c04db3745159 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:30:45.612363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5e69efba-b30f-46c4-a285-c04db3745159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:45.621637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:30:45.912982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bc970-317c-43c5-a19c-ae5d55006538 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:30:45.931336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bc970-317c-43c5-a19c-ae5d55006538 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:30:45.945086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125b491-c809-4099-a32c-e702bfa0d647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:30:45.945602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b491-c809-4099-a32c-e702bfa0d647 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:45.945952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b491-c809-4099-a32c-e702bfa0d647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:45.946285 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b491-c809-4099-a32c-e702bfa0d647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:45.956712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125b491-c809-4099-a32c-e702bfa0d647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:30:45.958153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125b491-c809-4099-a32c-e702bfa0d647 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:30:45.968388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 772/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:30:49.535669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788e01f-0d2c-40a5-8954-fa061ea2b608 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:49.536579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788e01f-0d2c-40a5-8954-fa061ea2b608 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:49.536579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788e01f-0d2c-40a5-8954-fa061ea2b608 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:49.538541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:30:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:30:49.543983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78ab61-a214-449e-b2b6-678ef67cd9a0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:49.544423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78ab61-a214-449e-b2b6-678ef67cd9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:49.544540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78ab61-a214-449e-b2b6-678ef67cd9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:49.552788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=81 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:30:49.568183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3f78ab61-a214-449e-b2b6-678ef67cd9a0 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:30:49.569374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3f78ab61-a214-449e-b2b6-678ef67cd9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:49.579469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:30:49.882234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788e01f-0d2c-40a5-8954-fa061ea2b608 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:30:49.884282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f788e01f-0d2c-40a5-8954-fa061ea2b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:49.955377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:30:49.970726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788e01f-0d2c-40a5-8954-fa061ea2b608 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:30:49.974939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacb129-a419-4b8a-9e61-0c5fb0195306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:30:49.975562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacb129-a419-4b8a-9e61-0c5fb0195306 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:49.975843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacb129-a419-4b8a-9e61-0c5fb0195306 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:49.976096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacb129-a419-4b8a-9e61-0c5fb0195306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:49.985347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacb129-a419-4b8a-9e61-0c5fb0195306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:30:49.986778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacb129-a419-4b8a-9e61-0c5fb0195306 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:30:49.996671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 763/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:30:52.155157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87cee3-ffd4-4b3b-9e6d-bba1d33d49b1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:52.155787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87cee3-ffd4-4b3b-9e6d-bba1d33d49b1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:52.155787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87cee3-ffd4-4b3b-9e6d-bba1d33d49b1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:52.157090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 04:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:30:52.163439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34ea9f-7bc6-422a-98a8-80a794ecfab9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:52.163857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34ea9f-7bc6-422a-98a8-80a794ecfab9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:52.163973 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34ea9f-7bc6-422a-98a8-80a794ecfab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:52.187388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8d34ea9f-7bc6-422a-98a8-80a794ecfab9 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:30:52.188586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8d34ea9f-7bc6-422a-98a8-80a794ecfab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:52.196629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 04:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:30:52.493129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87cee3-ffd4-4b3b-9e6d-bba1d33d49b1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:30:52.495221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fb87cee3-ffd4-4b3b-9e6d-bba1d33d49b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:30:52.509940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87cee3-ffd4-4b3b-9e6d-bba1d33d49b1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:30:52.513814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c111b7-4043-49f7-8bd2-b45df23c2031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:30:52.514424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c111b7-4043-49f7-8bd2-b45df23c2031 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:30:52.514693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c111b7-4043-49f7-8bd2-b45df23c2031 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:30:52.514966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c111b7-4043-49f7-8bd2-b45df23c2031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:30:52.524128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c111b7-4043-49f7-8bd2-b45df23c2031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:30:52.525566 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c111b7-4043-49f7-8bd2-b45df23c2031 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:30:52.534998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 775/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:31:02.182510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=11 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:31:02.530843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=8 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:26.123816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4ada-e3d7-4d64-bac6-6826830a7113 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.124585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4ada-e3d7-4d64-bac6-6826830a7113 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.124585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4ada-e3d7-4d64-bac6-6826830a7113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.147265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-58ef4ada-e3d7-4d64-bac6-6826830a7113 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.153387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-58ef4ada-e3d7-4d64-bac6-6826830a7113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.165281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 765/1540] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.175874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9701-1982-48aa-b990-261336868698 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.176440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9701-1982-48aa-b990-261336868698 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.176440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9701-1982-48aa-b990-261336868698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.208983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e1bc9701-1982-48aa-b990-261336868698 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.210343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e1bc9701-1982-48aa-b990-261336868698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.224537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 776/1541] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.229531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef4ada-e3d7-4d64-bac6-6826830a7113 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.243666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef4ada-e3d7-4d64-bac6-6826830a7113 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.248450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e0a0d-3a2a-4d46-8784-f5ccac7c9812 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.248745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e0a0d-3a2a-4d46-8784-f5ccac7c9812 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.249022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e0a0d-3a2a-4d46-8784-f5ccac7c9812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.251815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f9d7-f610-4b8b-9289-2a49250774b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.252721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f9d7-f610-4b8b-9289-2a49250774b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.253370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f9d7-f610-4b8b-9289-2a49250774b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.253952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f9d7-f610-4b8b-9289-2a49250774b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.254979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933f9d7-f610-4b8b-9289-2a49250774b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:26.255684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933f9d7-f610-4b8b-9289-2a49250774b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.257597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933f9d7-f610-4b8b-9289-2a49250774b5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.281949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 766/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:32:26.290030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f9d7-f610-4b8b-9289-2a49250774b5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.294789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-881e0a0d-3a2a-4d46-8784-f5ccac7c9812 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.296044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-881e0a0d-3a2a-4d46-8784-f5ccac7c9812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.302491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f9d7-f610-4b8b-9289-2a49250774b5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.311354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 777/1543] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:32:26.315615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e84a4-3f8f-4798-8e68-7cd296114b2a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.315902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e84a4-3f8f-4798-8e68-7cd296114b2a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.316172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e84a4-3f8f-4798-8e68-7cd296114b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.327283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3984c7e-8b6b-43c6-91d7-ca72dc44c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.328325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984c7e-8b6b-43c6-91d7-ca72dc44c6cc admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.328917 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984c7e-8b6b-43c6-91d7-ca72dc44c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.329530 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984c7e-8b6b-43c6-91d7-ca72dc44c6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.330387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3984c7e-8b6b-43c6-91d7-ca72dc44c6cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.331660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-a3984c7e-8b6b-43c6-91d7-ca72dc44c6cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:32:26.331660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: warnings.warn(msg) Oct 06 04:32:26.331660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: Oct 06 04:32:26.333507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3984c7e-8b6b-43c6-91d7-ca72dc44c6cc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.359264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9e7e84a4-3f8f-4798-8e68-7cd296114b2a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.360506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9e7e84a4-3f8f-4798-8e68-7cd296114b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.385561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 778/1544] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.386960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009bd4e-f53a-4bc2-8686-f1b10f6946fc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.387264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009bd4e-f53a-4bc2-8686-f1b10f6946fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.387647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009bd4e-f53a-4bc2-8686-f1b10f6946fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.402185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 767/1545] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:32:26.404221 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495746c-631a-4e92-881f-48be6d6dbb5b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.404743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495746c-631a-4e92-881f-48be6d6dbb5b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.405313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495746c-631a-4e92-881f-48be6d6dbb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.418222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3009bd4e-f53a-4bc2-8686-f1b10f6946fc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.419462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3009bd4e-f53a-4bc2-8686-f1b10f6946fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.429636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d495746c-631a-4e92-881f-48be6d6dbb5b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.431936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d495746c-631a-4e92-881f-48be6d6dbb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.481671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 779/1546] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.485596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f46d96-0b9d-4cdd-ac5e-3c46b80e148b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.485596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f46d96-0b9d-4cdd-ac5e-3c46b80e148b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.485596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f46d96-0b9d-4cdd-ac5e-3c46b80e148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.493409 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 768/1547] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.494701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba458c-6521-4882-9c4c-bffe1b27c95f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.494983 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba458c-6521-4882-9c4c-bffe1b27c95f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.495229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba458c-6521-4882-9c4c-bffe1b27c95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.504311 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c1f46d96-0b9d-4cdd-ac5e-3c46b80e148b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.505703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c1f46d96-0b9d-4cdd-ac5e-3c46b80e148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.515230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 780/1548] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.516034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f46d96-0b9d-4cdd-ac5e-3c46b80e148b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.517697 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-49ba458c-6521-4882-9c4c-bffe1b27c95f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.518866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-49ba458c-6521-4882-9c4c-bffe1b27c95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.526942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 769/1549] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.527769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f46d96-0b9d-4cdd-ac5e-3c46b80e148b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.528228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521ce9-644b-4da1-b1bd-31ee4f258df6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.528502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521ce9-644b-4da1-b1bd-31ee4f258df6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.528772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521ce9-644b-4da1-b1bd-31ee4f258df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.532975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c34758-a009-4937-9779-1d2f6100b54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.533588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c34758-a009-4937-9779-1d2f6100b54c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.533860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c34758-a009-4937-9779-1d2f6100b54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.534134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c34758-a009-4937-9779-1d2f6100b54c admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.534766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c34758-a009-4937-9779-1d2f6100b54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.535818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-08c34758-a009-4937-9779-1d2f6100b54c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:32:26.535818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: warnings.warn(msg) Oct 06 04:32:26.535818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: Oct 06 04:32:26.537227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c34758-a009-4937-9779-1d2f6100b54c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.548297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a0521ce9-644b-4da1-b1bd-31ee4f258df6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.549500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a0521ce9-644b-4da1-b1bd-31ee4f258df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.557466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 770/1550] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.558785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6384763-978b-4708-b7bf-87e3021f04d1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.559081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6384763-978b-4708-b7bf-87e3021f04d1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.559472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6384763-978b-4708-b7bf-87e3021f04d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.560969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 781/1551] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:26.562293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9f08c-723f-4a4b-ac88-b165767b12a8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.562521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9f08c-723f-4a4b-ac88-b165767b12a8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.562800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9f08c-723f-4a4b-ac88-b165767b12a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.579301 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a6384763-978b-4708-b7bf-87e3021f04d1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.580512 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a6384763-978b-4708-b7bf-87e3021f04d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.583870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cbc9f08c-723f-4a4b-ac88-b165767b12a8 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.585053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cbc9f08c-723f-4a4b-ac88-b165767b12a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.588222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 771/1552] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.589071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6384763-978b-4708-b7bf-87e3021f04d1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.596423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 782/1553] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.597678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a86a17-0be3-436b-b5e6-aed0bc8fe59f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.598137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a86a17-0be3-436b-b5e6-aed0bc8fe59f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.598415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a86a17-0be3-436b-b5e6-aed0bc8fe59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.606918 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6384763-978b-4708-b7bf-87e3021f04d1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.611771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453756d-c2f9-4665-8126-141ee4e52029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.612421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453756d-c2f9-4665-8126-141ee4e52029 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.612726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453756d-c2f9-4665-8126-141ee4e52029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.613038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453756d-c2f9-4665-8126-141ee4e52029 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.614076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453756d-c2f9-4665-8126-141ee4e52029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:26.614374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453756d-c2f9-4665-8126-141ee4e52029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.616023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453756d-c2f9-4665-8126-141ee4e52029 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.618652 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-16a86a17-0be3-436b-b5e6-aed0bc8fe59f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.619850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-16a86a17-0be3-436b-b5e6-aed0bc8fe59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.631567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 783/1554] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.631755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 772/1555] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:32:26.631755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453756d-c2f9-4665-8126-141ee4e52029 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.631948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052384a-fd5d-4e95-97ba-6a29b5c0c44c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.631948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052384a-fd5d-4e95-97ba-6a29b5c0c44c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.631948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052384a-fd5d-4e95-97ba-6a29b5c0c44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.642318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453756d-c2f9-4665-8126-141ee4e52029 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.646855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f67ffd-8e73-4a1f-863f-4b864e83e8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.647484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f67ffd-8e73-4a1f-863f-4b864e83e8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.647763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f67ffd-8e73-4a1f-863f-4b864e83e8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.648024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f67ffd-8e73-4a1f-863f-4b864e83e8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.648718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f67ffd-8e73-4a1f-863f-4b864e83e8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:26.648954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f67ffd-8e73-4a1f-863f-4b864e83e8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.649581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9052384a-fd5d-4e95-97ba-6a29b5c0c44c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.650536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f67ffd-8e73-4a1f-863f-4b864e83e8f4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.650768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9052384a-fd5d-4e95-97ba-6a29b5c0c44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.658669 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 784/1556] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.659467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052384a-fd5d-4e95-97ba-6a29b5c0c44c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.663078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 773/1557] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:32:26.664377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfff6c-7680-4f77-8b56-549f0300d855 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.664815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfff6c-7680-4f77-8b56-549f0300d855 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.665005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfff6c-7680-4f77-8b56-549f0300d855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.669591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052384a-fd5d-4e95-97ba-6a29b5c0c44c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.674196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85122c-6f35-41cc-a86b-fbf9c20235c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.674856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85122c-6f35-41cc-a86b-fbf9c20235c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.675135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85122c-6f35-41cc-a86b-fbf9c20235c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.675436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85122c-6f35-41cc-a86b-fbf9c20235c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.676090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85122c-6f35-41cc-a86b-fbf9c20235c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.677714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85122c-6f35-41cc-a86b-fbf9c20235c2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.685295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-37bfff6c-7680-4f77-8b56-549f0300d855 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.686427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-37bfff6c-7680-4f77-8b56-549f0300d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.688230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 785/1558] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:26.689227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53414560-d190-43d0-adec-3dfb7a71a3e6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.689509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53414560-d190-43d0-adec-3dfb7a71a3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.689785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53414560-d190-43d0-adec-3dfb7a71a3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.696660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 774/1559] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.698117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adc132-20ff-49a0-a2c1-280966403759 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.698396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adc132-20ff-49a0-a2c1-280966403759 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.698723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adc132-20ff-49a0-a2c1-280966403759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.709204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-53414560-d190-43d0-adec-3dfb7a71a3e6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.710400 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-53414560-d190-43d0-adec-3dfb7a71a3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.718382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-12adc132-20ff-49a0-a2c1-280966403759 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:26.718871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 786/1560] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.719534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-12adc132-20ff-49a0-a2c1-280966403759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:26.719770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53414560-d190-43d0-adec-3dfb7a71a3e6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.728625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 775/1561] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:26.728950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53414560-d190-43d0-adec-3dfb7a71a3e6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.729276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adc132-20ff-49a0-a2c1-280966403759 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.733772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2fd2-fe76-47f6-9321-67db1a5c9db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.734569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2fd2-fe76-47f6-9321-67db1a5c9db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.734843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2fd2-fe76-47f6-9321-67db1a5c9db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.735686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2fd2-fe76-47f6-9321-67db1a5c9db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.736346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c2fd2-fe76-47f6-9321-67db1a5c9db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:26.736813 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c2fd2-fe76-47f6-9321-67db1a5c9db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.737844 dv-cinder-860227-2-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-b93c2fd2-fe76-47f6-9321-67db1a5c9db3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:32:26.737844 dv-cinder-860227-2-smb devstack@keystone.service[81437]: warnings.warn(msg) Oct 06 04:32:26.737844 dv-cinder-860227-2-smb devstack@keystone.service[81437]: Oct 06 04:32:26.739093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adc132-20ff-49a0-a2c1-280966403759 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.739201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c2fd2-fe76-47f6-9321-67db1a5c9db3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.743882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57069e25-5ca6-41f8-960e-e01e36a2b8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.744469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57069e25-5ca6-41f8-960e-e01e36a2b8fc admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.744743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57069e25-5ca6-41f8-960e-e01e36a2b8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.745014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57069e25-5ca6-41f8-960e-e01e36a2b8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.745634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57069e25-5ca6-41f8-960e-e01e36a2b8fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.748226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57069e25-5ca6-41f8-960e-e01e36a2b8fc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.758330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 787/1562] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:32:26.758330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2fd2-fe76-47f6-9321-67db1a5c9db3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.762829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2fd2-fe76-47f6-9321-67db1a5c9db3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.769057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17958314-c7c7-4f74-91f0-72b31aed0bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.769805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17958314-c7c7-4f74-91f0-72b31aed0bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.770124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17958314-c7c7-4f74-91f0-72b31aed0bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.770430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17958314-c7c7-4f74-91f0-72b31aed0bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.771407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17958314-c7c7-4f74-91f0-72b31aed0bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:26.771702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17958314-c7c7-4f74-91f0-72b31aed0bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.773424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17958314-c7c7-4f74-91f0-72b31aed0bd5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.777793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 776/1563] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:26.778588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57069e25-5ca6-41f8-960e-e01e36a2b8fc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.794281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 788/1564] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:32:26.794281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17958314-c7c7-4f74-91f0-72b31aed0bd5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.797967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17958314-c7c7-4f74-91f0-72b31aed0bd5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.817725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:26.848033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:26.849591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57069e25-5ca6-41f8-960e-e01e36a2b8fc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.854611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c191eb0-9da0-47fd-8b0f-39def589a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.855215 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c191eb0-9da0-47fd-8b0f-39def589a024 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.855576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c191eb0-9da0-47fd-8b0f-39def589a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.855841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c191eb0-9da0-47fd-8b0f-39def589a024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.856489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c191eb0-9da0-47fd-8b0f-39def589a024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.858517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb35ae4-6b98-47e7-9006-cedac7d2a441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.858670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c191eb0-9da0-47fd-8b0f-39def589a024 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.859125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb35ae4-6b98-47e7-9006-cedac7d2a441 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.859435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb35ae4-6b98-47e7-9006-cedac7d2a441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.859707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb35ae4-6b98-47e7-9006-cedac7d2a441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.860360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb35ae4-6b98-47e7-9006-cedac7d2a441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.862015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb35ae4-6b98-47e7-9006-cedac7d2a441 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.872699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 789/1565] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:26.873535 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb35ae4-6b98-47e7-9006-cedac7d2a441 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.884085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb35ae4-6b98-47e7-9006-cedac7d2a441 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.889138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe1d52-d986-4251-a4f7-195efcebd1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.893031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 777/1566] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:26.893186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1d52-d986-4251-a4f7-195efcebd1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.893293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c191eb0-9da0-47fd-8b0f-39def589a024 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.893386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1d52-d986-4251-a4f7-195efcebd1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.893386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1d52-d986-4251-a4f7-195efcebd1a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.893386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe1d52-d986-4251-a4f7-195efcebd1a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:26.893386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe1d52-d986-4251-a4f7-195efcebd1a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.893386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe1d52-d986-4251-a4f7-195efcebd1a3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.907236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 790/1567] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:32:26.907236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe1d52-d986-4251-a4f7-195efcebd1a3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.926334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe1d52-d986-4251-a4f7-195efcebd1a3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.964796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c191eb0-9da0-47fd-8b0f-39def589a024 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:26.970337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74693aa8-bbd7-4db5-963f-bf2d84f0b84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:26.971112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74693aa8-bbd7-4db5-963f-bf2d84f0b84c admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:26.971434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74693aa8-bbd7-4db5-963f-bf2d84f0b84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:26.971689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74693aa8-bbd7-4db5-963f-bf2d84f0b84c admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:26.972342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74693aa8-bbd7-4db5-963f-bf2d84f0b84c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:26.972641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74693aa8-bbd7-4db5-963f-bf2d84f0b84c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:26.974289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74693aa8-bbd7-4db5-963f-bf2d84f0b84c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:26.986912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 778/1568] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:32:26.987753 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74693aa8-bbd7-4db5-963f-bf2d84f0b84c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:26.998130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74693aa8-bbd7-4db5-963f-bf2d84f0b84c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.000516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c40de8-0aaf-4125-abfd-c7cdd5c869a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.001167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c40de8-0aaf-4125-abfd-c7cdd5c869a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.001439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c40de8-0aaf-4125-abfd-c7cdd5c869a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.001721 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c40de8-0aaf-4125-abfd-c7cdd5c869a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.002368 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c40de8-0aaf-4125-abfd-c7cdd5c869a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:27.002663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c40de8-0aaf-4125-abfd-c7cdd5c869a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.002769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40b773-59e4-4b8f-a9c2-02a4477a26a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.003356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b773-59e4-4b8f-a9c2-02a4477a26a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.003660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b773-59e4-4b8f-a9c2-02a4477a26a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.003927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b773-59e4-4b8f-a9c2-02a4477a26a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.004549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b773-59e4-4b8f-a9c2-02a4477a26a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.004867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c40de8-0aaf-4125-abfd-c7cdd5c869a0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.006410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b773-59e4-4b8f-a9c2-02a4477a26a2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.017214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 791/1569] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:32:27.018005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c40de8-0aaf-4125-abfd-c7cdd5c869a0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.034966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c40de8-0aaf-4125-abfd-c7cdd5c869a0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.041007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 779/1570] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:26 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.041831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced9df2-7eee-4952-9032-c806fa2fb2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.042446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced9df2-7eee-4952-9032-c806fa2fb2ac admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.042717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced9df2-7eee-4952-9032-c806fa2fb2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.043078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced9df2-7eee-4952-9032-c806fa2fb2ac admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.044154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced9df2-7eee-4952-9032-c806fa2fb2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.044285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40b773-59e4-4b8f-a9c2-02a4477a26a2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.046183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced9df2-7eee-4952-9032-c806fa2fb2ac admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.069334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 792/1571] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/users => generated 291 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.070269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced9df2-7eee-4952-9032-c806fa2fb2ac admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.079946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced9df2-7eee-4952-9032-c806fa2fb2ac admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.108796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40b773-59e4-4b8f-a9c2-02a4477a26a2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.113808 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1457a94-6190-415d-bb55-f6d7ecb9e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.114423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1457a94-6190-415d-bb55-f6d7ecb9e532 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.114696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1457a94-6190-415d-bb55-f6d7ecb9e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.114961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1457a94-6190-415d-bb55-f6d7ecb9e532 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.115651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1457a94-6190-415d-bb55-f6d7ecb9e532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.117560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1457a94-6190-415d-bb55-f6d7ecb9e532 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.136055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c772be-45a2-4b5d-aef4-11a8f40076dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.136781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c772be-45a2-4b5d-aef4-11a8f40076dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.137205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c772be-45a2-4b5d-aef4-11a8f40076dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.137490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c772be-45a2-4b5d-aef4-11a8f40076dd admin admin] PATH_INFO: `/v3/projects/4bb59165f9cd40b6b82046e8cc3f7b09/users/74e7a0ccd3fc41db9b9c9a7234853277/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.145302 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 780/1572] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.146110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1457a94-6190-415d-bb55-f6d7ecb9e532 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.155839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c772be-45a2-4b5d-aef4-11a8f40076dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb59165f9cd40b6b82046e8cc3f7b09, user_id=74e7a0ccd3fc41db9b9c9a7234853277, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.158539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c772be-45a2-4b5d-aef4-11a8f40076dd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.158929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:27.172705 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 793/1573] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:27 2022] PUT /identity/v3/projects/4bb59165f9cd40b6b82046e8cc3f7b09/users/74e7a0ccd3fc41db9b9c9a7234853277/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:27.173568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c772be-45a2-4b5d-aef4-11a8f40076dd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.210051 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:27.210742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1457a94-6190-415d-bb55-f6d7ecb9e532 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.234286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c772be-45a2-4b5d-aef4-11a8f40076dd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.242091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba521bdd-8b6d-431d-bc88-6275cc8ecccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.243166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521bdd-8b6d-431d-bc88-6275cc8ecccb admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.243512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521bdd-8b6d-431d-bc88-6275cc8ecccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.243789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521bdd-8b6d-431d-bc88-6275cc8ecccb admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.244575 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba521bdd-8b6d-431d-bc88-6275cc8ecccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.246545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba521bdd-8b6d-431d-bc88-6275cc8ecccb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.272006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d714d30-d255-4e8b-b994-109aa2056326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.272789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714d30-d255-4e8b-b994-109aa2056326 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.273171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714d30-d255-4e8b-b994-109aa2056326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.273545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714d30-d255-4e8b-b994-109aa2056326 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.274455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d714d30-d255-4e8b-b994-109aa2056326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.278252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 794/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.278252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba521bdd-8b6d-431d-bc88-6275cc8ecccb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.278485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d714d30-d255-4e8b-b994-109aa2056326 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.305036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 781/1575] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.305036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d714d30-d255-4e8b-b994-109aa2056326 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.320343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d714d30-d255-4e8b-b994-109aa2056326 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.347713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba521bdd-8b6d-431d-bc88-6275cc8ecccb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.352720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb899bb-3b5c-4295-a519-e6bdf0ea2ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.353771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb899bb-3b5c-4295-a519-e6bdf0ea2ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.354050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb899bb-3b5c-4295-a519-e6bdf0ea2ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.354988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb899bb-3b5c-4295-a519-e6bdf0ea2ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.354988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb899bb-3b5c-4295-a519-e6bdf0ea2ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.357056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb899bb-3b5c-4295-a519-e6bdf0ea2ae6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.385335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 795/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.386090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb899bb-3b5c-4295-a519-e6bdf0ea2ae6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.389451 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da30cb-1cee-4ea5-90d5-5e4a756ea542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.390073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da30cb-1cee-4ea5-90d5-5e4a756ea542 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.390346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da30cb-1cee-4ea5-90d5-5e4a756ea542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.390636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da30cb-1cee-4ea5-90d5-5e4a756ea542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.391272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da30cb-1cee-4ea5-90d5-5e4a756ea542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.393247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da30cb-1cee-4ea5-90d5-5e4a756ea542 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.421093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 782/1577] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.421974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da30cb-1cee-4ea5-90d5-5e4a756ea542 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.452453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb899bb-3b5c-4295-a519-e6bdf0ea2ae6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.457009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:27.484784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da30cb-1cee-4ea5-90d5-5e4a756ea542 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.489605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892560c-3815-4ad3-82ea-7be3e5a16d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.490217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892560c-3815-4ad3-82ea-7be3e5a16d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.490496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892560c-3815-4ad3-82ea-7be3e5a16d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.490757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892560c-3815-4ad3-82ea-7be3e5a16d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.491424 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892560c-3815-4ad3-82ea-7be3e5a16d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.493029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892560c-3815-4ad3-82ea-7be3e5a16d12 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.500382 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:27.506390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 783/1578] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.506390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892560c-3815-4ad3-82ea-7be3e5a16d12 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.515250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb878268-30fd-4334-bd51-bd609d8fa0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.515919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb878268-30fd-4334-bd51-bd609d8fa0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.516197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb878268-30fd-4334-bd51-bd609d8fa0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.516467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb878268-30fd-4334-bd51-bd609d8fa0ce admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.517116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb878268-30fd-4334-bd51-bd609d8fa0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.517897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892560c-3815-4ad3-82ea-7be3e5a16d12 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.519082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb878268-30fd-4334-bd51-bd609d8fa0ce admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.526112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f02e59-c08a-481a-ac74-4472a8a01c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.526722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f02e59-c08a-481a-ac74-4472a8a01c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.526999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f02e59-c08a-481a-ac74-4472a8a01c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.527265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f02e59-c08a-481a-ac74-4472a8a01c7d admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.527990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f02e59-c08a-481a-ac74-4472a8a01c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.529894 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f02e59-c08a-481a-ac74-4472a8a01c7d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.542301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 796/1579] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.543748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0461-50fe-4a7c-8fac-201e6eeedb81 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.544105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0461-50fe-4a7c-8fac-201e6eeedb81 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.544378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0461-50fe-4a7c-8fac-201e6eeedb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.554015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 784/1580] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/users => generated 290 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.555002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f02e59-c08a-481a-ac74-4472a8a01c7d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.563858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a23d0461-50fe-4a7c-8fac-201e6eeedb81 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:27.565056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a23d0461-50fe-4a7c-8fac-201e6eeedb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:27.568127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f02e59-c08a-481a-ac74-4472a8a01c7d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.572772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 797/1581] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:27.573825 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0461-50fe-4a7c-8fac-201e6eeedb81 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.576257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f30b1-3614-454e-be5c-69ea69b21b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.577027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f30b1-3614-454e-be5c-69ea69b21b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.577306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f30b1-3614-454e-be5c-69ea69b21b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.577626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f30b1-3614-454e-be5c-69ea69b21b67 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.578405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f30b1-3614-454e-be5c-69ea69b21b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.580768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f30b1-3614-454e-be5c-69ea69b21b67 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.583137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0461-50fe-4a7c-8fac-201e6eeedb81 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.587834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0cf0a-9cb7-44c9-b7c7-220c8e6bb8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.588432 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0cf0a-9cb7-44c9-b7c7-220c8e6bb8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.588743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0cf0a-9cb7-44c9-b7c7-220c8e6bb8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.589007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0cf0a-9cb7-44c9-b7c7-220c8e6bb8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.589636 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0cf0a-9cb7-44c9-b7c7-220c8e6bb8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.591587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0cf0a-9cb7-44c9-b7c7-220c8e6bb8b3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.602523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 798/1582] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.603331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0cf0a-9cb7-44c9-b7c7-220c8e6bb8b3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.604332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 785/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/users => generated 286 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.605123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f30b1-3614-454e-be5c-69ea69b21b67 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.613354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0cf0a-9cb7-44c9-b7c7-220c8e6bb8b3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.616796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f30b1-3614-454e-be5c-69ea69b21b67 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.618278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de59213-de63-48df-b2d6-62d969a62b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.618877 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de59213-de63-48df-b2d6-62d969a62b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.619150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de59213-de63-48df-b2d6-62d969a62b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.619457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de59213-de63-48df-b2d6-62d969a62b7b admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.620086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de59213-de63-48df-b2d6-62d969a62b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.621603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319619e1-ad21-48f6-8acf-9ccd3ce69f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.622147 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de59213-de63-48df-b2d6-62d969a62b7b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.622269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319619e1-ad21-48f6-8acf-9ccd3ce69f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.622444 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319619e1-ad21-48f6-8acf-9ccd3ce69f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.622711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319619e1-ad21-48f6-8acf-9ccd3ce69f64 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.623353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319619e1-ad21-48f6-8acf-9ccd3ce69f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.625228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319619e1-ad21-48f6-8acf-9ccd3ce69f64 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.646559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 799/1584] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.646805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 786/1585] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:27 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:27.647563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319619e1-ad21-48f6-8acf-9ccd3ce69f64 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.648103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de59213-de63-48df-b2d6-62d969a62b7b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.659341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de59213-de63-48df-b2d6-62d969a62b7b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.659645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319619e1-ad21-48f6-8acf-9ccd3ce69f64 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.664546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf033e-5a03-4093-838a-3ff70bbd27a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.665269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e523b-b009-488f-880a-ff897aa9fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.665583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf033e-5a03-4093-838a-3ff70bbd27a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.665862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf033e-5a03-4093-838a-3ff70bbd27a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.665988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e523b-b009-488f-880a-ff897aa9fdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.666161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf033e-5a03-4093-838a-3ff70bbd27a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.666264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e523b-b009-488f-880a-ff897aa9fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.666438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e523b-b009-488f-880a-ff897aa9fdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.666770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf033e-5a03-4093-838a-3ff70bbd27a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.667031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e523b-b009-488f-880a-ff897aa9fdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.668683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e523b-b009-488f-880a-ff897aa9fdd9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.668789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf033e-5a03-4093-838a-3ff70bbd27a1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.679681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 800/1586] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.682915 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 787/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.683997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e523b-b009-488f-880a-ff897aa9fdd9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.684145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf033e-5a03-4093-838a-3ff70bbd27a1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.693638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf033e-5a03-4093-838a-3ff70bbd27a1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.698602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7e9f-f427-48bd-82b7-5993e9f5f87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.699501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7e9f-f427-48bd-82b7-5993e9f5f87d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.700274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7e9f-f427-48bd-82b7-5993e9f5f87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.700274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7e9f-f427-48bd-82b7-5993e9f5f87d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.700733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f7e9f-f427-48bd-82b7-5993e9f5f87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.702299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f7e9f-f427-48bd-82b7-5993e9f5f87d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.713019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 801/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.717152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7e9f-f427-48bd-82b7-5993e9f5f87d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.726904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7e9f-f427-48bd-82b7-5993e9f5f87d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.731729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe91b2-ecc5-4e53-bc37-464a2d02ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.732327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe91b2-ecc5-4e53-bc37-464a2d02ef23 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.732604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe91b2-ecc5-4e53-bc37-464a2d02ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.732873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe91b2-ecc5-4e53-bc37-464a2d02ef23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.733512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe91b2-ecc5-4e53-bc37-464a2d02ef23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.735297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe91b2-ecc5-4e53-bc37-464a2d02ef23 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.743781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e523b-b009-488f-880a-ff897aa9fdd9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.745629 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 802/1589] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.746507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe91b2-ecc5-4e53-bc37-464a2d02ef23 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.747876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4047e32-9df0-4b8a-a1af-36775b02dceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.748481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047e32-9df0-4b8a-a1af-36775b02dceb service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.749020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047e32-9df0-4b8a-a1af-36775b02dceb service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.749156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047e32-9df0-4b8a-a1af-36775b02dceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.755810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe91b2-ecc5-4e53-bc37-464a2d02ef23 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.758276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047e32-9df0-4b8a-a1af-36775b02dceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.759756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047e32-9df0-4b8a-a1af-36775b02dceb service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.760507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4921822-7054-4105-993c-74380cb87534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.761083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4921822-7054-4105-993c-74380cb87534 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.761357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4921822-7054-4105-993c-74380cb87534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.761622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4921822-7054-4105-993c-74380cb87534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.762384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4921822-7054-4105-993c-74380cb87534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.763856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4921822-7054-4105-993c-74380cb87534 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.769308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 788/1590] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:27.770172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4047e32-9df0-4b8a-a1af-36775b02dceb service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.776151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 803/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.776308 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4921822-7054-4105-993c-74380cb87534 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.779715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4047e32-9df0-4b8a-a1af-36775b02dceb service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.784682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572203ec-5f7c-4bc3-be83-e1f3a1195c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.785164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572203ec-5f7c-4bc3-be83-e1f3a1195c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.785438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572203ec-5f7c-4bc3-be83-e1f3a1195c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.785728 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572203ec-5f7c-4bc3-be83-e1f3a1195c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.786333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572203ec-5f7c-4bc3-be83-e1f3a1195c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.787982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572203ec-5f7c-4bc3-be83-e1f3a1195c02 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.788141 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4921822-7054-4105-993c-74380cb87534 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.792982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442693f-c837-47b3-b205-208e721880e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.793996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442693f-c837-47b3-b205-208e721880e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.794371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442693f-c837-47b3-b205-208e721880e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.794654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442693f-c837-47b3-b205-208e721880e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.795544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442693f-c837-47b3-b205-208e721880e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.797269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442693f-c837-47b3-b205-208e721880e6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.801802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 789/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.801802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572203ec-5f7c-4bc3-be83-e1f3a1195c02 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.810249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572203ec-5f7c-4bc3-be83-e1f3a1195c02 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.812794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 804/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.813747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442693f-c837-47b3-b205-208e721880e6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.818158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c0da-e884-40d3-95fe-b3e07ef2e812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.818769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c0da-e884-40d3-95fe-b3e07ef2e812 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.819044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c0da-e884-40d3-95fe-b3e07ef2e812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.819339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c0da-e884-40d3-95fe-b3e07ef2e812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.819983 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c0da-e884-40d3-95fe-b3e07ef2e812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.821594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c0da-e884-40d3-95fe-b3e07ef2e812 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.826156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442693f-c837-47b3-b205-208e721880e6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.831641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82326c6b-8fe7-4195-8061-13a52d3a3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.832571 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82326c6b-8fe7-4195-8061-13a52d3a3a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.832958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82326c6b-8fe7-4195-8061-13a52d3a3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.833468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82326c6b-8fe7-4195-8061-13a52d3a3a53 admin admin] PATH_INFO: `/v3/projects/049bfc50e26249a29bfcc8189f66306d/users/f8045195f4644cb5aaf77b9fe32282e1/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.833584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 790/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.837457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c0da-e884-40d3-95fe-b3e07ef2e812 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.847941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c0da-e884-40d3-95fe-b3e07ef2e812 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.849286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82326c6b-8fe7-4195-8061-13a52d3a3a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=049bfc50e26249a29bfcc8189f66306d, user_id=f8045195f4644cb5aaf77b9fe32282e1, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.852084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82326c6b-8fe7-4195-8061-13a52d3a3a53 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.852807 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d79618-b5ea-416a-9f49-39ba8e756db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.853413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d79618-b5ea-416a-9f49-39ba8e756db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.853672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d79618-b5ea-416a-9f49-39ba8e756db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.853938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d79618-b5ea-416a-9f49-39ba8e756db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.854574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d79618-b5ea-416a-9f49-39ba8e756db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.856307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d79618-b5ea-416a-9f49-39ba8e756db3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.868319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 805/1595] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:27 2022] PUT /identity/v3/projects/049bfc50e26249a29bfcc8189f66306d/users/f8045195f4644cb5aaf77b9fe32282e1/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:27.868553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 791/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.868967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82326c6b-8fe7-4195-8061-13a52d3a3a53 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.873933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d79618-b5ea-416a-9f49-39ba8e756db3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.884894 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d79618-b5ea-416a-9f49-39ba8e756db3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.923352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:27.943909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82326c6b-8fe7-4195-8061-13a52d3a3a53 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.949052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02839-0d2f-44ef-a9d9-47245c651969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.949847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02839-0d2f-44ef-a9d9-47245c651969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.950170 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02839-0d2f-44ef-a9d9-47245c651969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.950373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02839-0d2f-44ef-a9d9-47245c651969 admin admin] PATH_INFO: `/v3/projects/275d2beeacbc4d0989bd2fccd2a7fb9a/users/f9fa14a6ce9c4a9db1619d68e8ef926f/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.954014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae8dc-d925-4da1-a30f-11eb178096ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:27.954620 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae8dc-d925-4da1-a30f-11eb178096ca admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:27.954895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae8dc-d925-4da1-a30f-11eb178096ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:27.955164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae8dc-d925-4da1-a30f-11eb178096ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:27.955842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae8dc-d925-4da1-a30f-11eb178096ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.957459 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae8dc-d925-4da1-a30f-11eb178096ca admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.966965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce02839-0d2f-44ef-a9d9-47245c651969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=275d2beeacbc4d0989bd2fccd2a7fb9a, user_id=f9fa14a6ce9c4a9db1619d68e8ef926f, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:27.973846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce02839-0d2f-44ef-a9d9-47245c651969 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:27.974007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 792/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:27.974007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae8dc-d925-4da1-a30f-11eb178096ca admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:27.987928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae8dc-d925-4da1-a30f-11eb178096ca admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:27.994733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 806/1598] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:27 2022] PUT /identity/v3/projects/275d2beeacbc4d0989bd2fccd2a7fb9a/users/f9fa14a6ce9c4a9db1619d68e8ef926f/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:27.995856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02839-0d2f-44ef-a9d9-47245c651969 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:28.017549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:28.060027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b16b80-8cf2-4311-b39e-2f4b6a2680cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:28.060792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16b80-8cf2-4311-b39e-2f4b6a2680cb admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.061140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16b80-8cf2-4311-b39e-2f4b6a2680cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.061421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16b80-8cf2-4311-b39e-2f4b6a2680cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.062080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b16b80-8cf2-4311-b39e-2f4b6a2680cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:28.063751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b16b80-8cf2-4311-b39e-2f4b6a2680cb admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:28.078257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 793/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:28.078257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b16b80-8cf2-4311-b39e-2f4b6a2680cb admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:28.082075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02839-0d2f-44ef-a9d9-47245c651969 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:28.086925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9e95-4a0d-4372-b257-f5913fa586fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:28.087775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9e95-4a0d-4372-b257-f5913fa586fd admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.087913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b16b80-8cf2-4311-b39e-2f4b6a2680cb admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:28.088313 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9e95-4a0d-4372-b257-f5913fa586fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.088720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9e95-4a0d-4372-b257-f5913fa586fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.089525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f9e95-4a0d-4372-b257-f5913fa586fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:28.091600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f9e95-4a0d-4372-b257-f5913fa586fd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:28.094391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27c24e-d9a3-48c6-af78-25db8ac69ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:28.095071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27c24e-d9a3-48c6-af78-25db8ac69ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.095378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27c24e-d9a3-48c6-af78-25db8ac69ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.095658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27c24e-d9a3-48c6-af78-25db8ac69ed4 admin admin] PATH_INFO: `/v3/projects/d2cbf46d72284ccea45654fef46d0039/users/cad23c2633ac4c70a0fea40d9f5390b3/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.103470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 807/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:28.104303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9e95-4a0d-4372-b257-f5913fa586fd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:28.114954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27c24e-d9a3-48c6-af78-25db8ac69ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2cbf46d72284ccea45654fef46d0039, user_id=cad23c2633ac4c70a0fea40d9f5390b3, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:28.115179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9e95-4a0d-4372-b257-f5913fa586fd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:28.116189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-9d27c24e-d9a3-48c6-af78-25db8ac69ed4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:32:28.116189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: warnings.warn(msg) Oct 06 04:32:28.116189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: Oct 06 04:32:28.118281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27c24e-d9a3-48c6-af78-25db8ac69ed4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:28.120145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fdb81-c9ac-48dd-8239-8c8daf89e74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:28.120906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fdb81-c9ac-48dd-8239-8c8daf89e74c admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.121214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fdb81-c9ac-48dd-8239-8c8daf89e74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.121758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fdb81-c9ac-48dd-8239-8c8daf89e74c admin admin] PATH_INFO: `/v3/projects/4ce37172c0c34b8e9f342775a6b8ebdb/users/deea84058f724ff3b78caa9d8b010202/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.134422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 794/1601] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:28 2022] PUT /identity/v3/projects/d2cbf46d72284ccea45654fef46d0039/users/cad23c2633ac4c70a0fea40d9f5390b3/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:28.135469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726ceb-fc8a-4826-98ff-9dacda45ccc0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.135746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726ceb-fc8a-4826-98ff-9dacda45ccc0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.136189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726ceb-fc8a-4826-98ff-9dacda45ccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.139828 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fdb81-c9ac-48dd-8239-8c8daf89e74c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce37172c0c34b8e9f342775a6b8ebdb, user_id=deea84058f724ff3b78caa9d8b010202, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:28.142546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fdb81-c9ac-48dd-8239-8c8daf89e74c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:28.161781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 808/1602] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:28 2022] PUT /identity/v3/projects/4ce37172c0c34b8e9f342775a6b8ebdb/users/deea84058f724ff3b78caa9d8b010202/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:28.162300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fdb81-c9ac-48dd-8239-8c8daf89e74c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:28.171682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-87726ceb-fc8a-4826-98ff-9dacda45ccc0 None None] MFA Rules not processed for user `f8045195f4644cb5aaf77b9fe32282e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:28.173500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-87726ceb-fc8a-4826-98ff-9dacda45ccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:28.231856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fdb81-c9ac-48dd-8239-8c8daf89e74c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:28.237439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd5c4-b86d-4c12-bd4f-3410bbfa3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:28.238109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd5c4-b86d-4c12-bd4f-3410bbfa3185 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.238790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd5c4-b86d-4c12-bd4f-3410bbfa3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.239164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd5c4-b86d-4c12-bd4f-3410bbfa3185 admin admin] PATH_INFO: `/v3/projects/dbaf9e258e8a4eaebd589fbc467755b3/users/389545d6dded4c37982ef607319dd835/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.256689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 795/1603] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:28.257656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fd5c4-b86d-4c12-bd4f-3410bbfa3185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbaf9e258e8a4eaebd589fbc467755b3, user_id=389545d6dded4c37982ef607319dd835, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:28.260666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee4fc-ff58-4231-8d40-d2fd8e6bffa7 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.260903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fd5c4-b86d-4c12-bd4f-3410bbfa3185 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:28.266287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee4fc-ff58-4231-8d40-d2fd8e6bffa7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.266613 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee4fc-ff58-4231-8d40-d2fd8e6bffa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.278344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 809/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:28 2022] PUT /identity/v3/projects/dbaf9e258e8a4eaebd589fbc467755b3/users/389545d6dded4c37982ef607319dd835/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:28.279580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd5c4-b86d-4c12-bd4f-3410bbfa3185 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:28.328171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-36fee4fc-ff58-4231-8d40-d2fd8e6bffa7 None None] MFA Rules not processed for user `f9fa14a6ce9c4a9db1619d68e8ef926f`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:28.329557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-36fee4fc-ff58-4231-8d40-d2fd8e6bffa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:28.359786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd5c4-b86d-4c12-bd4f-3410bbfa3185 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:28.364024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:28.369043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cc2cf-9bb0-4e6c-b416-494bd59d7a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:28.370190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cc2cf-9bb0-4e6c-b416-494bd59d7a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.370471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cc2cf-9bb0-4e6c-b416-494bd59d7a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.370746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cc2cf-9bb0-4e6c-b416-494bd59d7a1a admin admin] PATH_INFO: `/v3/projects/ea299ab316884af5bdad2ea131658d48/users/0a64dd6dfd6c478eaabb44f2d1614472/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.384332 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:28.389092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cc2cf-9bb0-4e6c-b416-494bd59d7a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea299ab316884af5bdad2ea131658d48, user_id=0a64dd6dfd6c478eaabb44f2d1614472, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:28.392999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cc2cf-9bb0-4e6c-b416-494bd59d7a1a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:28.410709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 810/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:28 2022] PUT /identity/v3/projects/ea299ab316884af5bdad2ea131658d48/users/0a64dd6dfd6c478eaabb44f2d1614472/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:28.411588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cc2cf-9bb0-4e6c-b416-494bd59d7a1a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:28.422354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 796/1606] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:28.424950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d3ed5-7124-4a84-aa84-53e382127568 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.425435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d3ed5-7124-4a84-aa84-53e382127568 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.425869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d3ed5-7124-4a84-aa84-53e382127568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.478284 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-409d3ed5-7124-4a84-aa84-53e382127568 None None] MFA Rules not processed for user `cad23c2633ac4c70a0fea40d9f5390b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:28.480078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-409d3ed5-7124-4a84-aa84-53e382127568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:28.483508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cc2cf-9bb0-4e6c-b416-494bd59d7a1a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:28.489636 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8308f-8cd3-4fc0-92d7-598866ef35f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:28.490677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8308f-8cd3-4fc0-92d7-598866ef35f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.490677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8308f-8cd3-4fc0-92d7-598866ef35f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.491339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8308f-8cd3-4fc0-92d7-598866ef35f4 admin admin] PATH_INFO: `/v3/projects/e4fef755a3b34cb68b757b8bbaa00bed/users/3b8b820bb8ad4599837afad008daf413/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.510486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8308f-8cd3-4fc0-92d7-598866ef35f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fef755a3b34cb68b757b8bbaa00bed, user_id=3b8b820bb8ad4599837afad008daf413, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:28.514348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8308f-8cd3-4fc0-92d7-598866ef35f4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:28.535468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 811/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:28 2022] PUT /identity/v3/projects/e4fef755a3b34cb68b757b8bbaa00bed/users/3b8b820bb8ad4599837afad008daf413/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:28.536818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231515-2207-4679-a08b-ea7a8bd6ff0a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.537351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231515-2207-4679-a08b-ea7a8bd6ff0a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.537674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231515-2207-4679-a08b-ea7a8bd6ff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.559272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 797/1608] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:28.562629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea582aa-b6c6-4585-bb45-427b34a869c2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.563070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea582aa-b6c6-4585-bb45-427b34a869c2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.563716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea582aa-b6c6-4585-bb45-427b34a869c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.568902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bc231515-2207-4679-a08b-ea7a8bd6ff0a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:28.570597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bc231515-2207-4679-a08b-ea7a8bd6ff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:28.605148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5ea582aa-b6c6-4585-bb45-427b34a869c2 None None] MFA Rules not processed for user `389545d6dded4c37982ef607319dd835`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:28.607426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5ea582aa-b6c6-4585-bb45-427b34a869c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:28.661172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 812/1609] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:28.663219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2722b-a6a6-40fb-bad8-cf332fe471df None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.663370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2722b-a6a6-40fb-bad8-cf332fe471df None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.663640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2722b-a6a6-40fb-bad8-cf332fe471df None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.670791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 813/1610] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 6 04:32:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:32:28.674924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68f0f3-34b1-4ab1-a436-d74d7b69c538 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.675262 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68f0f3-34b1-4ab1-a436-d74d7b69c538 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.676260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68f0f3-34b1-4ab1-a436-d74d7b69c538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.707371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 798/1611] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:28.708878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ca7a5-beea-4fcf-a94c-8840a739e312 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.709162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ca7a5-beea-4fcf-a94c-8840a739e312 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.709431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ca7a5-beea-4fcf-a94c-8840a739e312 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.715473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 799/1612] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 6 04:32:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:32:28.716728 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a047368-bb2d-4546-8cc3-1fe60d0d65aa None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.716962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bd68f0f3-34b1-4ab1-a436-d74d7b69c538 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:28.717121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a047368-bb2d-4546-8cc3-1fe60d0d65aa None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.717259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a047368-bb2d-4546-8cc3-1fe60d0d65aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.718194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bd68f0f3-34b1-4ab1-a436-d74d7b69c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:28.727388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 814/1613] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:28.728458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68f0f3-34b1-4ab1-a436-d74d7b69c538 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:28.740152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0a047368-bb2d-4546-8cc3-1fe60d0d65aa None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:28.741350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0a047368-bb2d-4546-8cc3-1fe60d0d65aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:28.754482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 800/1614] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:28.758086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcb0f9-5f75-462c-9b93-b8d91d82fb8a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.758368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcb0f9-5f75-462c-9b93-b8d91d82fb8a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.758634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcb0f9-5f75-462c-9b93-b8d91d82fb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.801989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-edbcb0f9-5f75-462c-9b93-b8d91d82fb8a None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:28.803874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-edbcb0f9-5f75-462c-9b93-b8d91d82fb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:28.816867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68f0f3-34b1-4ab1-a436-d74d7b69c538 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:28.821479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37e7f1-8852-4e91-a39b-2faf92b104bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:28.822208 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37e7f1-8852-4e91-a39b-2faf92b104bd service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.822488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37e7f1-8852-4e91-a39b-2faf92b104bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.822888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37e7f1-8852-4e91-a39b-2faf92b104bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.827023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:28.848197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:28.896799 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 801/1615] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 6 04:32:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:28.900596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37e7f1-8852-4e91-a39b-2faf92b104bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:28.902177 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37e7f1-8852-4e91-a39b-2faf92b104bd service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:28.907394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcb0f9-5f75-462c-9b93-b8d91d82fb8a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:28.909604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-edbcb0f9-5f75-462c-9b93-b8d91d82fb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:28.913762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 815/1616] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:28.914924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37e7f1-8852-4e91-a39b-2faf92b104bd service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:28.929088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37e7f1-8852-4e91-a39b-2faf92b104bd service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:28.935554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224d53b-00b9-41bd-8ae5-c8450d93086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:28.936413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d53b-00b9-41bd-8ae5-c8450d93086b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.936835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d53b-00b9-41bd-8ae5-c8450d93086b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.937273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d53b-00b9-41bd-8ae5-c8450d93086b admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:28.938248 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224d53b-00b9-41bd-8ae5-c8450d93086b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:28.940719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224d53b-00b9-41bd-8ae5-c8450d93086b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:28.980526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 816/1617] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:28 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:28.982104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcb0f9-5f75-462c-9b93-b8d91d82fb8a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:28.986805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527d9f2-46db-4df4-8c89-1ea7243576a2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:28.987092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527d9f2-46db-4df4-8c89-1ea7243576a2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:28.988075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527d9f2-46db-4df4-8c89-1ea7243576a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:29.022143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5527d9f2-46db-4df4-8c89-1ea7243576a2 None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:29.024872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5527d9f2-46db-4df4-8c89-1ea7243576a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:29.036137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc011d-361d-4fd6-9e26-a6acbe47fa4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:29.037023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc011d-361d-4fd6-9e26-a6acbe47fa4a service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:29.037388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc011d-361d-4fd6-9e26-a6acbe47fa4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:29.037727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc011d-361d-4fd6-9e26-a6acbe47fa4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:29.135785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc011d-361d-4fd6-9e26-a6acbe47fa4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:29.140386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc011d-361d-4fd6-9e26-a6acbe47fa4a service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:29.156790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 817/1618] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 6 04:32:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:29.165436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527d9f2-46db-4df4-8c89-1ea7243576a2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:29.177238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 802/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:29.179898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc011d-361d-4fd6-9e26-a6acbe47fa4a service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:29.190545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527d9f2-46db-4df4-8c89-1ea7243576a2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:29.196280 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc011d-361d-4fd6-9e26-a6acbe47fa4a service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:29.198711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2de08-21a1-42b9-b7bd-b51ca98eb8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:29.199644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2de08-21a1-42b9-b7bd-b51ca98eb8ab service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:29.200435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2de08-21a1-42b9-b7bd-b51ca98eb8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:29.202290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2de08-21a1-42b9-b7bd-b51ca98eb8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:29.207813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b47b6-ef3e-45e5-9929-98a953b86c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:29.208720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b47b6-ef3e-45e5-9929-98a953b86c1c service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:29.209419 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b47b6-ef3e-45e5-9929-98a953b86c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:29.210126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b47b6-ef3e-45e5-9929-98a953b86c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:29.220889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2de08-21a1-42b9-b7bd-b51ca98eb8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:29.222988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2de08-21a1-42b9-b7bd-b51ca98eb8ab service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:29.233246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b47b6-ef3e-45e5-9929-98a953b86c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:29.236139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b47b6-ef3e-45e5-9929-98a953b86c1c service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:29.239329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 818/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:29.240977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2de08-21a1-42b9-b7bd-b51ca98eb8ab service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:29.261781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2de08-21a1-42b9-b7bd-b51ca98eb8ab service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:29.264775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 803/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:29.265744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b47b6-ef3e-45e5-9929-98a953b86c1c service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:29.278285 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6fe9-4e08-478b-95b3-f87985acc50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:29.278922 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6fe9-4e08-478b-95b3-f87985acc50a service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:29.279196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6fe9-4e08-478b-95b3-f87985acc50a service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:29.279499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6fe9-4e08-478b-95b3-f87985acc50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:29.285627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b47b6-ef3e-45e5-9929-98a953b86c1c service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:29.297833 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fff8bf-df30-401c-872d-c09e2ab12653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:29.299274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fff8bf-df30-401c-872d-c09e2ab12653 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:29.300685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fff8bf-df30-401c-872d-c09e2ab12653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:29.301788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fff8bf-df30-401c-872d-c09e2ab12653 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:29.304613 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fff8bf-df30-401c-872d-c09e2ab12653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:29.306859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fff8bf-df30-401c-872d-c09e2ab12653 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:29.326678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:29.352525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 804/1622] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:29 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:29.353840 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fff8bf-df30-401c-872d-c09e2ab12653 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:29.384575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fff8bf-df30-401c-872d-c09e2ab12653 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:29.403463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d722c2-d799-44d2-bfe1-734d21eb6b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:29.404185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d722c2-d799-44d2-bfe1-734d21eb6b38 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:29.404366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d722c2-d799-44d2-bfe1-734d21eb6b38 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:29.404623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d722c2-d799-44d2-bfe1-734d21eb6b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:29.429303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc6fe9-4e08-478b-95b3-f87985acc50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:29.433715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc6fe9-4e08-478b-95b3-f87985acc50a service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:29.457486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 819/1623] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:29.458421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6fe9-4e08-478b-95b3-f87985acc50a service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:29.479740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6fe9-4e08-478b-95b3-f87985acc50a service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:29.494094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a942-3bef-4b45-92cc-9d164c294d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:29.495656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a942-3bef-4b45-92cc-9d164c294d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:29.495941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a942-3bef-4b45-92cc-9d164c294d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:29.497580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a942-3bef-4b45-92cc-9d164c294d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:29.498438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304a942-3bef-4b45-92cc-9d164c294d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:29.503731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304a942-3bef-4b45-92cc-9d164c294d71 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:29.542181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 820/1624] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:29.548216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a942-3bef-4b45-92cc-9d164c294d71 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:29.561647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d722c2-d799-44d2-bfe1-734d21eb6b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:29.563880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d722c2-d799-44d2-bfe1-734d21eb6b38 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:29.570729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:29.580379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a942-3bef-4b45-92cc-9d164c294d71 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:29.589869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b8a7f-463c-46dd-823d-feefc9423090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:29.592464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b8a7f-463c-46dd-823d-feefc9423090 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:29.592778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b8a7f-463c-46dd-823d-feefc9423090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:29.593224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b8a7f-463c-46dd-823d-feefc9423090 admin admin] PATH_INFO: `/v3/projects/eaaa44675c4b4c418e61002223651f24/users/932cfa53ce3640e48e103511967e1fe4/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:29.605907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 805/1625] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:29.635365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b8a7f-463c-46dd-823d-feefc9423090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaaa44675c4b4c418e61002223651f24, user_id=932cfa53ce3640e48e103511967e1fe4, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:29.644584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b8a7f-463c-46dd-823d-feefc9423090 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:29.675723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 821/1626] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:29 2022] PUT /identity/v3/projects/eaaa44675c4b4c418e61002223651f24/users/932cfa53ce3640e48e103511967e1fe4/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:29.676926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d722c2-d799-44d2-bfe1-734d21eb6b38 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:29.692786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d722c2-d799-44d2-bfe1-734d21eb6b38 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:29.934258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f8e7d-340b-468c-8dd7-88b0a6664fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:29.934892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f8e7d-340b-468c-8dd7-88b0a6664fae admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:29.935217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f8e7d-340b-468c-8dd7-88b0a6664fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:29.935560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f8e7d-340b-468c-8dd7-88b0a6664fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:29.936218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f8e7d-340b-468c-8dd7-88b0a6664fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:30.031727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f8e7d-340b-468c-8dd7-88b0a6664fae admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:30.031727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 806/1627] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:32:30.032427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b8a7f-463c-46dd-823d-feefc9423090 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:30.051739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b8a7f-463c-46dd-823d-feefc9423090 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:30.070229 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639af520-f579-45ae-9865-23a36e2c821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:30.074140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639af520-f579-45ae-9865-23a36e2c821a admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:30.074889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639af520-f579-45ae-9865-23a36e2c821a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:30.075241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639af520-f579-45ae-9865-23a36e2c821a admin admin] PATH_INFO: `/v3/projects/eaaa44675c4b4c418e61002223651f24/users/932cfa53ce3640e48e103511967e1fe4/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:30.087426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639af520-f579-45ae-9865-23a36e2c821a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaaa44675c4b4c418e61002223651f24, user_id=932cfa53ce3640e48e103511967e1fe4, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:30.100777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639af520-f579-45ae-9865-23a36e2c821a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:30.150530 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 822/1628] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:29 2022] PUT /identity/v3/projects/eaaa44675c4b4c418e61002223651f24/users/932cfa53ce3640e48e103511967e1fe4/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:30.159349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b87428-7561-4c88-baf6-7c1261133cca None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:30.159872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b87428-7561-4c88-baf6-7c1261133cca None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:30.166325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b87428-7561-4c88-baf6-7c1261133cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:30.189667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19e9b-c3e0-42c9-b652-cd96d75619fd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:30.189992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19e9b-c3e0-42c9-b652-cd96d75619fd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:30.190457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19e9b-c3e0-42c9-b652-cd96d75619fd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:30.191926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 823/1629] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 6 04:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:32:30.199273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3b7a8-e9d5-469b-a10a-aa095565ab19 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:30.199590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3b7a8-e9d5-469b-a10a-aa095565ab19 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:30.199862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3b7a8-e9d5-469b-a10a-aa095565ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:30.244128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-92b87428-7561-4c88-baf6-7c1261133cca None None] MFA Rules not processed for user `932cfa53ce3640e48e103511967e1fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:30.245482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-92b87428-7561-4c88-baf6-7c1261133cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:30.248353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b4e3b7a8-e9d5-469b-a10a-aa095565ab19 None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:30.249593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b4e3b7a8-e9d5-469b-a10a-aa095565ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:30.395600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 824/1630] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:32:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:32:30.397745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb885e72-29a5-4c9b-85af-b652575a64d2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:30.398027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb885e72-29a5-4c9b-85af-b652575a64d2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:30.398296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb885e72-29a5-4c9b-85af-b652575a64d2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:30.401250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 825/1631] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 6 04:32:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:32:30.408581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605cf4-f570-4b48-93d2-34a3a640a440 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:30.408900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605cf4-f570-4b48-93d2-34a3a640a440 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:30.409133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605cf4-f570-4b48-93d2-34a3a640a440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:30.437663 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 807/1632] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:30.438682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b87428-7561-4c88-baf6-7c1261133cca None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:30.462188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6c605cf4-f570-4b48-93d2-34a3a640a440 None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:30.463135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:30.466851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6c605cf4-f570-4b48-93d2-34a3a640a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:30.491742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 826/1633] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:32:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:30.492709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c605cf4-f570-4b48-93d2-34a3a640a440 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:30.565538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b87428-7561-4c88-baf6-7c1261133cca None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:30.578322 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875697-a251-4cdd-88f3-3857167834e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:30.579729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875697-a251-4cdd-88f3-3857167834e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:30.580108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875697-a251-4cdd-88f3-3857167834e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:30.581027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875697-a251-4cdd-88f3-3857167834e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:30.583508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c605cf4-f570-4b48-93d2-34a3a640a440 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:30.588887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd025b-4097-47cf-a120-ae5ea5302a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:30.588887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd025b-4097-47cf-a120-ae5ea5302a5a service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:30.589227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd025b-4097-47cf-a120-ae5ea5302a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:30.589337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd025b-4097-47cf-a120-ae5ea5302a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:30.605242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875697-a251-4cdd-88f3-3857167834e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:30.607588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875697-a251-4cdd-88f3-3857167834e4 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:30.618773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd025b-4097-47cf-a120-ae5ea5302a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:30.620544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd025b-4097-47cf-a120-ae5ea5302a5a service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:30.635422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 827/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:30.649596 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 808/1635] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:30.758541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd025b-4097-47cf-a120-ae5ea5302a5a service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:30.769970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd025b-4097-47cf-a120-ae5ea5302a5a service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:30.774670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f126e42-7686-49fe-8be4-1a6b395bf985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:30.775651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f126e42-7686-49fe-8be4-1a6b395bf985 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:30.776079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f126e42-7686-49fe-8be4-1a6b395bf985 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:30.776562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f126e42-7686-49fe-8be4-1a6b395bf985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:30.800890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f126e42-7686-49fe-8be4-1a6b395bf985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:30.802684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f126e42-7686-49fe-8be4-1a6b395bf985 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:30.822203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 828/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:31.119662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875697-a251-4cdd-88f3-3857167834e4 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:31.138886 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875697-a251-4cdd-88f3-3857167834e4 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:31.163217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bab64-51aa-43db-803a-6ae92590db3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:31.164503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bab64-51aa-43db-803a-6ae92590db3c service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:31.165023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bab64-51aa-43db-803a-6ae92590db3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:31.166035 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bab64-51aa-43db-803a-6ae92590db3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:31.341849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bab64-51aa-43db-803a-6ae92590db3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:31.348292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bab64-51aa-43db-803a-6ae92590db3c service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:31.374931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 809/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:31.440116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f126e42-7686-49fe-8be4-1a6b395bf985 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:31.570050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:31.606463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f126e42-7686-49fe-8be4-1a6b395bf985 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:31.617781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:31.619729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:31.620286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:31.622580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] PATH_INFO: `/v3/users/f9fa14a6ce9c4a9db1619d68e8ef926f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:31.624308 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9fa14a6ce9c4a9db1619d68e8ef926f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:31.627284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:31.744574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9fa14a6ce9c4a9db1619d68e8ef926f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:31.784220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9fa14a6ce9c4a9db1619d68e8ef926f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:31.807689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9fa14a6ce9c4a9db1619d68e8ef926f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:31.810656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9fa14a6ce9c4a9db1619d68e8ef926f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:31.836098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9fa14a6ce9c4a9db1619d68e8ef926f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:31.844755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 829/1638] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:32:31 2022] DELETE /identity/v3/users/f9fa14a6ce9c4a9db1619d68e8ef926f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:31.849375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3e5a-8a76-4e3a-a5c4-c87ac0bb2761 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:31.849671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3e5a-8a76-4e3a-a5c4-c87ac0bb2761 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:31.849924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3e5a-8a76-4e3a-a5c4-c87ac0bb2761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:31.904839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c79c3e5a-8a76-4e3a-a5c4-c87ac0bb2761 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:31.909478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c79c3e5a-8a76-4e3a-a5c4-c87ac0bb2761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:32.099524 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 810/1639] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:32.107734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:32.111996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:32.334556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9ec9b-1401-4ff3-acbc-76ac2b4bcb29 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:32.338539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339a105-572c-44a7-a7be-ca7a4b12c5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:32.339593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a105-572c-44a7-a7be-ca7a4b12c5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:32.340131 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a105-572c-44a7-a7be-ca7a4b12c5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:32.340529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a105-572c-44a7-a7be-ca7a4b12c5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:32.352664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339a105-572c-44a7-a7be-ca7a4b12c5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:32.354406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339a105-572c-44a7-a7be-ca7a4b12c5e1 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:32.381833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 830/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:33.565944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3e5a-8a76-4e3a-a5c4-c87ac0bb2761 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:33.567972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c79c3e5a-8a76-4e3a-a5c4-c87ac0bb2761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:33.590678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3e5a-8a76-4e3a-a5c4-c87ac0bb2761 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:33.604162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:33.604969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:33.607553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:33.608015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] PATH_INFO: `/v3/projects/275d2beeacbc4d0989bd2fccd2a7fb9a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:33.618078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=275d2beeacbc4d0989bd2fccd2a7fb9a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:33.620476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:33.720091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:33.730223 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '275d2beeacbc4d0989bd2fccd2a7fb9a', 'request_id': 'req-49868e63-0b03-4ab1-b9f9-1138d9aceff3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:33.745213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '275d2beeacbc4d0989bd2fccd2a7fb9a', 'request_id': 'req-49868e63-0b03-4ab1-b9f9-1138d9aceff3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:33.756759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '275d2beeacbc4d0989bd2fccd2a7fb9a', 'request_id': 'req-49868e63-0b03-4ab1-b9f9-1138d9aceff3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:33.781468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] The token cache is being invalidate because project 275d2beeacbc4d0989bd2fccd2a7fb9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:32:33.782534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:33.804806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49868e63-0b03-4ab1-b9f9-1138d9aceff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:33.807670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 811/1641] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:32:33 2022] DELETE /identity/v3/projects/275d2beeacbc4d0989bd2fccd2a7fb9a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:33.815015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009062c-31ae-4fc7-bb22-27493627bb50 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:33.815617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009062c-31ae-4fc7-bb22-27493627bb50 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:33.815796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009062c-31ae-4fc7-bb22-27493627bb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:33.883711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6009062c-31ae-4fc7-bb22-27493627bb50 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:33.893041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6009062c-31ae-4fc7-bb22-27493627bb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:34.138444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 831/1642] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:34.146995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af719df-155b-43d3-830e-87786be81d93 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:34.147590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af719df-155b-43d3-830e-87786be81d93 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:34.148050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af719df-155b-43d3-830e-87786be81d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:34.190800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6af719df-155b-43d3-830e-87786be81d93 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:34.192503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6af719df-155b-43d3-830e-87786be81d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:34.231812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 812/1643] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:34.232287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009062c-31ae-4fc7-bb22-27493627bb50 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:34.240493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:34.247544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009062c-31ae-4fc7-bb22-27493627bb50 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:34.255661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8daf69-dd22-4299-984b-93439cac7a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:34.256687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8daf69-dd22-4299-984b-93439cac7a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:34.257149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8daf69-dd22-4299-984b-93439cac7a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:34.257661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8daf69-dd22-4299-984b-93439cac7a81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:34.258872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8daf69-dd22-4299-984b-93439cac7a81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:34.259420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8daf69-dd22-4299-984b-93439cac7a81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:34.262359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8daf69-dd22-4299-984b-93439cac7a81 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:34.282637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af719df-155b-43d3-830e-87786be81d93 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:34.289643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 832/1644] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:32:34.293591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af719df-155b-43d3-830e-87786be81d93 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:34.322025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5104690-180d-496a-9907-67a5432cf08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:34.322826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5104690-180d-496a-9907-67a5432cf08f admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:34.323212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5104690-180d-496a-9907-67a5432cf08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:34.323619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5104690-180d-496a-9907-67a5432cf08f admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:34.325094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5104690-180d-496a-9907-67a5432cf08f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:34.332232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5104690-180d-496a-9907-67a5432cf08f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:34.393998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 813/1645] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:34 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:34.398732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8daf69-dd22-4299-984b-93439cac7a81 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:34.412878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8daf69-dd22-4299-984b-93439cac7a81 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:34.509924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142d471-36a0-4011-b629-69df73e4d5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:34.510817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142d471-36a0-4011-b629-69df73e4d5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:34.511093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142d471-36a0-4011-b629-69df73e4d5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:34.511389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142d471-36a0-4011-b629-69df73e4d5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:34.512538 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142d471-36a0-4011-b629-69df73e4d5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:34.515180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142d471-36a0-4011-b629-69df73e4d5d9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:34.553371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 833/1646] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:34 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:34.555396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5104690-180d-496a-9907-67a5432cf08f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:34.575794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5104690-180d-496a-9907-67a5432cf08f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:34.588007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547440a-b179-428b-b7e6-f66f522baac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:34.590218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547440a-b179-428b-b7e6-f66f522baac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:34.590875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547440a-b179-428b-b7e6-f66f522baac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:34.591754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547440a-b179-428b-b7e6-f66f522baac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:34.594529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547440a-b179-428b-b7e6-f66f522baac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:34.599715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547440a-b179-428b-b7e6-f66f522baac0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:34.635611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 814/1647] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:34.638722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142d471-36a0-4011-b629-69df73e4d5d9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:34.654764 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142d471-36a0-4011-b629-69df73e4d5d9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:34.664762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c245e2-187d-4b2b-b00a-102af248d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:34.666417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c245e2-187d-4b2b-b00a-102af248d541 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:34.666716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c245e2-187d-4b2b-b00a-102af248d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:34.667064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c245e2-187d-4b2b-b00a-102af248d541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:34.668912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c245e2-187d-4b2b-b00a-102af248d541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:34.673246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c245e2-187d-4b2b-b00a-102af248d541 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:34.710673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 834/1648] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:32:34.716071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547440a-b179-428b-b7e6-f66f522baac0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:34.736002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547440a-b179-428b-b7e6-f66f522baac0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:34.748808 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28ecde-5d5d-4bfa-a810-e6a7bda998c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:34.752131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28ecde-5d5d-4bfa-a810-e6a7bda998c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:34.752657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28ecde-5d5d-4bfa-a810-e6a7bda998c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:34.755786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28ecde-5d5d-4bfa-a810-e6a7bda998c3 admin admin] PATH_INFO: `/v3/projects/c7a9e1d0b8c04e5eb307a2122fcec019/users/d7cda20efa524612a206325e4c129e5d/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:34.793704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28ecde-5d5d-4bfa-a810-e6a7bda998c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a9e1d0b8c04e5eb307a2122fcec019, user_id=d7cda20efa524612a206325e4c129e5d, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:34.801594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28ecde-5d5d-4bfa-a810-e6a7bda998c3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:34.830404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 815/1649] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:34 2022] PUT /identity/v3/projects/c7a9e1d0b8c04e5eb307a2122fcec019/users/d7cda20efa524612a206325e4c129e5d/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:34.846904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2912ff-5e3f-487c-afde-4e659732620f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:34.846904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2912ff-5e3f-487c-afde-4e659732620f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:34.847451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2912ff-5e3f-487c-afde-4e659732620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:34.911042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ec2912ff-5e3f-487c-afde-4e659732620f None None] MFA Rules not processed for user `d7cda20efa524612a206325e4c129e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:34.912267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ec2912ff-5e3f-487c-afde-4e659732620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:35.056088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 835/1650] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:35.061141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28ecde-5d5d-4bfa-a810-e6a7bda998c3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:35.181497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28ecde-5d5d-4bfa-a810-e6a7bda998c3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:35.186672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82505a-3fda-43c7-b299-f7fe3913b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:35.187482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82505a-3fda-43c7-b299-f7fe3913b6aa admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:35.187760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82505a-3fda-43c7-b299-f7fe3913b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:35.188046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82505a-3fda-43c7-b299-f7fe3913b6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:35.188725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82505a-3fda-43c7-b299-f7fe3913b6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:35.190936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82505a-3fda-43c7-b299-f7fe3913b6aa admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:35.253294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 816/1651] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:35 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:35.257719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2912ff-5e3f-487c-afde-4e659732620f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:35.273919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2912ff-5e3f-487c-afde-4e659732620f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:35.429842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861048bd-3bd5-4609-bd6b-e0c09198fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:35.430459 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861048bd-3bd5-4609-bd6b-e0c09198fdf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:35.430734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861048bd-3bd5-4609-bd6b-e0c09198fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:35.431002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861048bd-3bd5-4609-bd6b-e0c09198fdf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:35.431672 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861048bd-3bd5-4609-bd6b-e0c09198fdf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:35.433744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861048bd-3bd5-4609-bd6b-e0c09198fdf6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:35.451723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:35.511242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82505a-3fda-43c7-b299-f7fe3913b6aa admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:35.513602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 836/1652] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:35 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:35.535603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82505a-3fda-43c7-b299-f7fe3913b6aa admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:35.560631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad18ef3-aa9b-491e-bec0-31806caecd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:35.561263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad18ef3-aa9b-491e-bec0-31806caecd20 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:35.561535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad18ef3-aa9b-491e-bec0-31806caecd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:35.561800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad18ef3-aa9b-491e-bec0-31806caecd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:35.562453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad18ef3-aa9b-491e-bec0-31806caecd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:35.568687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad18ef3-aa9b-491e-bec0-31806caecd20 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:35.594167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861048bd-3bd5-4609-bd6b-e0c09198fdf6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:35.603821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 817/1653] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:35.615815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861048bd-3bd5-4609-bd6b-e0c09198fdf6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:35.625926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe3815-b9c4-4f36-820b-fb4ef2b29b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:35.630252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe3815-b9c4-4f36-820b-fb4ef2b29b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:35.630529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe3815-b9c4-4f36-820b-fb4ef2b29b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:35.630790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe3815-b9c4-4f36-820b-fb4ef2b29b2b admin admin] PATH_INFO: `/v3/projects/8a1767d62e20490ab8767bcef1c145eb/users/7655793f4cbb4f95b83f91b8a27d02a4/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:35.674902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe3815-b9c4-4f36-820b-fb4ef2b29b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1767d62e20490ab8767bcef1c145eb, user_id=7655793f4cbb4f95b83f91b8a27d02a4, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:35.681326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe3815-b9c4-4f36-820b-fb4ef2b29b2b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:35.716802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 837/1654] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:35 2022] PUT /identity/v3/projects/8a1767d62e20490ab8767bcef1c145eb/users/7655793f4cbb4f95b83f91b8a27d02a4/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:35.721391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad18ef3-aa9b-491e-bec0-31806caecd20 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:35.740477 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad18ef3-aa9b-491e-bec0-31806caecd20 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:35.883622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:35.946219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fe3f0-d16c-4e63-8710-fb92bbda41de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:35.948624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe3f0-d16c-4e63-8710-fb92bbda41de admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:35.952105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe3f0-d16c-4e63-8710-fb92bbda41de admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:35.953237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe3f0-d16c-4e63-8710-fb92bbda41de admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:35.954146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fe3f0-d16c-4e63-8710-fb92bbda41de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:35.968637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fe3f0-d16c-4e63-8710-fb92bbda41de admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:36.044656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe3815-b9c4-4f36-820b-fb4ef2b29b2b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:36.053313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 818/1655] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:36.058869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe3815-b9c4-4f36-820b-fb4ef2b29b2b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:36.078826 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e50c99-4a7d-4583-84a0-bd5e90a09b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:36.079456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e50c99-4a7d-4583-84a0-bd5e90a09b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:36.080261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e50c99-4a7d-4583-84a0-bd5e90a09b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:36.080583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e50c99-4a7d-4583-84a0-bd5e90a09b25 admin admin] PATH_INFO: `/v3/projects/8a1767d62e20490ab8767bcef1c145eb/users/7655793f4cbb4f95b83f91b8a27d02a4/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:36.086169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e50c99-4a7d-4583-84a0-bd5e90a09b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1767d62e20490ab8767bcef1c145eb, user_id=7655793f4cbb4f95b83f91b8a27d02a4, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:36.098256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e50c99-4a7d-4583-84a0-bd5e90a09b25 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:36.130596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 838/1656] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:36 2022] PUT /identity/v3/projects/8a1767d62e20490ab8767bcef1c145eb/users/7655793f4cbb4f95b83f91b8a27d02a4/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:32:36.150559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975d0dc-8ca2-4213-a793-f334d6caab31 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:36.150890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975d0dc-8ca2-4213-a793-f334d6caab31 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:36.151097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975d0dc-8ca2-4213-a793-f334d6caab31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:36.242004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1975d0dc-8ca2-4213-a793-f334d6caab31 None None] MFA Rules not processed for user `7655793f4cbb4f95b83f91b8a27d02a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:36.243482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1975d0dc-8ca2-4213-a793-f334d6caab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:36.545028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 819/1657] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:36.560116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e50c99-4a7d-4583-84a0-bd5e90a09b25 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:36.562024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e6e50c99-4a7d-4583-84a0-bd5e90a09b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:36.785184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e50c99-4a7d-4583-84a0-bd5e90a09b25 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:36.789190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a3e17-f16c-4c07-b430-7cdf643c9604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:36.789980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a3e17-f16c-4c07-b430-7cdf643c9604 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:36.790490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a3e17-f16c-4c07-b430-7cdf643c9604 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:36.790833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a3e17-f16c-4c07-b430-7cdf643c9604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:36.813848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a3e17-f16c-4c07-b430-7cdf643c9604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:36.815608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a3e17-f16c-4c07-b430-7cdf643c9604 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:36.882229 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 839/1658] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:37.049482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975d0dc-8ca2-4213-a793-f334d6caab31 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:37.051569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1975d0dc-8ca2-4213-a793-f334d6caab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:37.070437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975d0dc-8ca2-4213-a793-f334d6caab31 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:37.084336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49983291-5895-4e00-a6e0-712071bd417f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:37.085257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49983291-5895-4e00-a6e0-712071bd417f service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:37.085673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49983291-5895-4e00-a6e0-712071bd417f service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:37.086078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49983291-5895-4e00-a6e0-712071bd417f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:37.266281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49983291-5895-4e00-a6e0-712071bd417f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:37.268145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49983291-5895-4e00-a6e0-712071bd417f service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:37.283110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 820/1659] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:37.817545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a3e17-f16c-4c07-b430-7cdf643c9604 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:37.819071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1e6a3e17-f16c-4c07-b430-7cdf643c9604 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:38.047097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a3e17-f16c-4c07-b430-7cdf643c9604 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:38.077173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:38.078010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:38.078426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:38.078830 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] PATH_INFO: `/v3/users/f8045195f4644cb5aaf77b9fe32282e1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:38.084171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8045195f4644cb5aaf77b9fe32282e1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:38.086517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:38.252208 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8045195f4644cb5aaf77b9fe32282e1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:38.278501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8045195f4644cb5aaf77b9fe32282e1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:38.283032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:38.310267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8045195f4644cb5aaf77b9fe32282e1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:38.314237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8045195f4644cb5aaf77b9fe32282e1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:38.354611 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8045195f4644cb5aaf77b9fe32282e1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:38.374562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 840/1660] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:32:37 2022] DELETE /identity/v3/users/f8045195f4644cb5aaf77b9fe32282e1 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:38.376047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744940c-359a-43e6-950b-060cbe00cdb1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:38.376531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744940c-359a-43e6-950b-060cbe00cdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:38.376603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744940c-359a-43e6-950b-060cbe00cdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:38.431090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1744940c-359a-43e6-950b-060cbe00cdb1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:38.432393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1744940c-359a-43e6-950b-060cbe00cdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:38.557538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 821/1661] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:32:38.580808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:38.582546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:38.709972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55576696-1485-4a41-97e1-5976eb61ec21 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:38.716068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda6a7-024e-4d55-97b5-f9b9bba5b0b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:38.717045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda6a7-024e-4d55-97b5-f9b9bba5b0b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:38.717045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda6a7-024e-4d55-97b5-f9b9bba5b0b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:38.717448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda6a7-024e-4d55-97b5-f9b9bba5b0b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:38.734569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dda6a7-024e-4d55-97b5-f9b9bba5b0b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:38.736575 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dda6a7-024e-4d55-97b5-f9b9bba5b0b8 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:38.751797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 841/1662] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:38.830182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d23ca-f883-4223-a2ca-8b86e3ca2385 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:38.830817 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d23ca-f883-4223-a2ca-8b86e3ca2385 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:38.831298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d23ca-f883-4223-a2ca-8b86e3ca2385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:38.847729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:38.933025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a73d23ca-f883-4223-a2ca-8b86e3ca2385 None None] MFA Rules not processed for user `74e7a0ccd3fc41db9b9c9a7234853277`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:38.934526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a73d23ca-f883-4223-a2ca-8b86e3ca2385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:39.159181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 822/1663] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:39.172967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5712d9-d96d-44a6-aef1-a179d7faae4c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:39.173462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5712d9-d96d-44a6-aef1-a179d7faae4c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:39.173776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5712d9-d96d-44a6-aef1-a179d7faae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:39.229430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9a5712d9-d96d-44a6-aef1-a179d7faae4c None None] MFA Rules not processed for user `74e7a0ccd3fc41db9b9c9a7234853277`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:39.231481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9a5712d9-d96d-44a6-aef1-a179d7faae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:39.277725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 842/1664] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:39.288875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d23ca-f883-4223-a2ca-8b86e3ca2385 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:39.291823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a73d23ca-f883-4223-a2ca-8b86e3ca2385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:39.461395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d23ca-f883-4223-a2ca-8b86e3ca2385 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:39.474794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33696160-627b-4079-8f2a-e38718b0d5dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:39.477370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33696160-627b-4079-8f2a-e38718b0d5dd service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:39.478267 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33696160-627b-4079-8f2a-e38718b0d5dd service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:39.478759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33696160-627b-4079-8f2a-e38718b0d5dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:39.516558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33696160-627b-4079-8f2a-e38718b0d5dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:39.521336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33696160-627b-4079-8f2a-e38718b0d5dd service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:39.551648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 823/1665] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:40.407923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039b906-1f30-473a-98d0-3a84ae3d8100 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:40.408484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039b906-1f30-473a-98d0-3a84ae3d8100 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:40.408484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039b906-1f30-473a-98d0-3a84ae3d8100 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:40.410528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 843/1666] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 6 04:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:32:40.430895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f2da-f7a7-4855-aa85-dd53c08a0325 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:40.431209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f2da-f7a7-4855-aa85-dd53c08a0325 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:40.431683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f2da-f7a7-4855-aa85-dd53c08a0325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:40.556908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-49d3f2da-f7a7-4855-aa85-dd53c08a0325 None None] MFA Rules not processed for user `39ca0a824c4740dbb911bb1a38cfc47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:40.562123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-49d3f2da-f7a7-4855-aa85-dd53c08a0325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:40.583611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 824/1667] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:32:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:40.611662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039b906-1f30-473a-98d0-3a84ae3d8100 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:40.614309 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e039b906-1f30-473a-98d0-3a84ae3d8100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:40.637105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039b906-1f30-473a-98d0-3a84ae3d8100 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:40.647680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc61c2-2ed4-4e07-9d46-2e12fe05d56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:40.648659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc61c2-2ed4-4e07-9d46-2e12fe05d56e service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:40.654522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc61c2-2ed4-4e07-9d46-2e12fe05d56e service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:40.655656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc61c2-2ed4-4e07-9d46-2e12fe05d56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:40.678121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc61c2-2ed4-4e07-9d46-2e12fe05d56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:40.679925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc61c2-2ed4-4e07-9d46-2e12fe05d56e service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:40.711443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 844/1668] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:40.779603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3f2da-f7a7-4855-aa85-dd53c08a0325 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:40.781824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-49d3f2da-f7a7-4855-aa85-dd53c08a0325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:40.835855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3f2da-f7a7-4855-aa85-dd53c08a0325 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:40.855029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:40.856527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:40.857012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:40.857616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] PATH_INFO: `/v3/projects/049bfc50e26249a29bfcc8189f66306d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:40.861859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049bfc50e26249a29bfcc8189f66306d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:40.865152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:41.004370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049bfc50e26249a29bfcc8189f66306d', 'request_id': 'req-788ab0da-bf77-4afc-a46e-be124a9e1851'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:41.035761 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:41.047724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049bfc50e26249a29bfcc8189f66306d', 'request_id': 'req-788ab0da-bf77-4afc-a46e-be124a9e1851'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:41.064467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049bfc50e26249a29bfcc8189f66306d', 'request_id': 'req-788ab0da-bf77-4afc-a46e-be124a9e1851'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:41.098918 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] The token cache is being invalidate because project 049bfc50e26249a29bfcc8189f66306d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:32:41.099981 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:41.101606 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-788ab0da-bf77-4afc-a46e-be124a9e1851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:41.113991 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e63b3c-06d1-4200-8cb9-1f28481738d6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:41.115891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e63b3c-06d1-4200-8cb9-1f28481738d6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:41.116549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e63b3c-06d1-4200-8cb9-1f28481738d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:41.120207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 825/1669] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:32:40 2022] DELETE /identity/v3/projects/049bfc50e26249a29bfcc8189f66306d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:41.148594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-95e63b3c-06d1-4200-8cb9-1f28481738d6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:41.150726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-95e63b3c-06d1-4200-8cb9-1f28481738d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:41.422421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 845/1670] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:41.431786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88c7f2-88ce-4626-9b21-d28f58326c15 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:41.432290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88c7f2-88ce-4626-9b21-d28f58326c15 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:41.432787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88c7f2-88ce-4626-9b21-d28f58326c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:41.512669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1d88c7f2-88ce-4626-9b21-d28f58326c15 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:41.519082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1d88c7f2-88ce-4626-9b21-d28f58326c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:41.530144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 826/1671] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:41.535075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e63b3c-06d1-4200-8cb9-1f28481738d6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:41.553964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e63b3c-06d1-4200-8cb9-1f28481738d6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:41.561051 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90836839-09fd-4514-b4e0-e32154c3c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:41.562058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90836839-09fd-4514-b4e0-e32154c3c748 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:41.562447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90836839-09fd-4514-b4e0-e32154c3c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:41.563451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90836839-09fd-4514-b4e0-e32154c3c748 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:41.564348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90836839-09fd-4514-b4e0-e32154c3c748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:41.565330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90836839-09fd-4514-b4e0-e32154c3c748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:41.567760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90836839-09fd-4514-b4e0-e32154c3c748 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:41.590857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88c7f2-88ce-4626-9b21-d28f58326c15 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:41.603670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 846/1672] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:32:41.605625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88c7f2-88ce-4626-9b21-d28f58326c15 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:41.613349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afc37-e959-4422-9e76-bfbc4a72791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:41.614627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afc37-e959-4422-9e76-bfbc4a72791b admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:41.615029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afc37-e959-4422-9e76-bfbc4a72791b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:41.615439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afc37-e959-4422-9e76-bfbc4a72791b admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:41.616180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489afc37-e959-4422-9e76-bfbc4a72791b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:41.618222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489afc37-e959-4422-9e76-bfbc4a72791b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:41.661237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 827/1673] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:41 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:41.666514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90836839-09fd-4514-b4e0-e32154c3c748 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:41.678389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90836839-09fd-4514-b4e0-e32154c3c748 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:41.753564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:41.787130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149dcb7-6263-48ab-97c5-e1b8da4f47c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:41.790311 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149dcb7-6263-48ab-97c5-e1b8da4f47c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:41.790843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149dcb7-6263-48ab-97c5-e1b8da4f47c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:41.791377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149dcb7-6263-48ab-97c5-e1b8da4f47c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:41.792418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149dcb7-6263-48ab-97c5-e1b8da4f47c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:41.798255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149dcb7-6263-48ab-97c5-e1b8da4f47c8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:41.844278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 847/1674] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:41 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:41.848134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afc37-e959-4422-9e76-bfbc4a72791b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:41.866117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afc37-e959-4422-9e76-bfbc4a72791b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:41.884715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407d6e-5762-4dba-88d8-efa560187f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:41.885412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407d6e-5762-4dba-88d8-efa560187f2c admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:41.885688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407d6e-5762-4dba-88d8-efa560187f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:41.885992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407d6e-5762-4dba-88d8-efa560187f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:41.887008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407d6e-5762-4dba-88d8-efa560187f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:41.888891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407d6e-5762-4dba-88d8-efa560187f2c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:41.929043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 828/1675] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:41.930733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149dcb7-6263-48ab-97c5-e1b8da4f47c8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:41.973401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149dcb7-6263-48ab-97c5-e1b8da4f47c8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:42.000478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9599c62-dc15-40fc-b359-d021c132f732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:42.001937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9599c62-dc15-40fc-b359-d021c132f732 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:42.004100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9599c62-dc15-40fc-b359-d021c132f732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:42.004697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9599c62-dc15-40fc-b359-d021c132f732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:42.009267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9599c62-dc15-40fc-b359-d021c132f732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:42.011617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9599c62-dc15-40fc-b359-d021c132f732 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:42.052128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 848/1676] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:42.055589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407d6e-5762-4dba-88d8-efa560187f2c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:42.067603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407d6e-5762-4dba-88d8-efa560187f2c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:42.100839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e100b-9b36-45ce-a68a-612f0ab47cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:42.101626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e100b-9b36-45ce-a68a-612f0ab47cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:42.102028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e100b-9b36-45ce-a68a-612f0ab47cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:42.102320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e100b-9b36-45ce-a68a-612f0ab47cf3 admin admin] PATH_INFO: `/v3/projects/f592f9757154462c898a01afbcf14d0d/users/5f64be20c39e4abab065c2c9eb1cdeca/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:42.138596 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e100b-9b36-45ce-a68a-612f0ab47cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f592f9757154462c898a01afbcf14d0d, user_id=5f64be20c39e4abab065c2c9eb1cdeca, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:42.148445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e100b-9b36-45ce-a68a-612f0ab47cf3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:42.186754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 829/1677] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:42 2022] PUT /identity/v3/projects/f592f9757154462c898a01afbcf14d0d/users/5f64be20c39e4abab065c2c9eb1cdeca/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:42.188331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5c29b-fd15-478f-9cb1-33d1e303bfe1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:42.188616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5c29b-fd15-478f-9cb1-33d1e303bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:42.188886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5c29b-fd15-478f-9cb1-33d1e303bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:42.246034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fee5c29b-fd15-478f-9cb1-33d1e303bfe1 None None] MFA Rules not processed for user `5f64be20c39e4abab065c2c9eb1cdeca`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:42.248143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fee5c29b-fd15-478f-9cb1-33d1e303bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:42.422840 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 849/1678] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:32:42.434908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e100b-9b36-45ce-a68a-612f0ab47cf3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:42.437118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-719e100b-9b36-45ce-a68a-612f0ab47cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:42.503428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5c29b-fd15-478f-9cb1-33d1e303bfe1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:42.505485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fee5c29b-fd15-478f-9cb1-33d1e303bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:42.683449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e100b-9b36-45ce-a68a-612f0ab47cf3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:42.703515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984d9a3-dbfc-42f4-bf69-f3f8496e8d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:42.704858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984d9a3-dbfc-42f4-bf69-f3f8496e8d29 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:42.708581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984d9a3-dbfc-42f4-bf69-f3f8496e8d29 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:42.709153 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984d9a3-dbfc-42f4-bf69-f3f8496e8d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:42.752654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984d9a3-dbfc-42f4-bf69-f3f8496e8d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:42.758338 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984d9a3-dbfc-42f4-bf69-f3f8496e8d29 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:42.795664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5c29b-fd15-478f-9cb1-33d1e303bfe1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:42.806152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 830/1679] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:32:42.811380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984d9a3-dbfc-42f4-bf69-f3f8496e8d29 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:42.814486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c984d9a3-dbfc-42f4-bf69-f3f8496e8d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:42.826133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a070ff-d4c6-400e-b1f7-958ae31f2181 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:42.827459 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a070ff-d4c6-400e-b1f7-958ae31f2181 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:42.831501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a070ff-d4c6-400e-b1f7-958ae31f2181 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:42.831947 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a070ff-d4c6-400e-b1f7-958ae31f2181 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:42.845491 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b7a070ff-d4c6-400e-b1f7-958ae31f2181 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:42.875418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a070ff-d4c6-400e-b1f7-958ae31f2181 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:42.877018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a070ff-d4c6-400e-b1f7-958ae31f2181 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:42.896079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 850/1680] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:32:43.108601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984d9a3-dbfc-42f4-bf69-f3f8496e8d29 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:43.116222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:43.117021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:43.117277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:43.117543 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] PATH_INFO: `/v3/users/cad23c2633ac4c70a0fea40d9f5390b3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:43.118777 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad23c2633ac4c70a0fea40d9f5390b3)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:43.121028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:32:43.121028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: warnings.warn(msg) Oct 06 04:32:43.121028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: Oct 06 04:32:43.122234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:43.141091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:43.350932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad23c2633ac4c70a0fea40d9f5390b3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:43.351870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad23c2633ac4c70a0fea40d9f5390b3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:43.368170 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad23c2633ac4c70a0fea40d9f5390b3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:43.424320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad23c2633ac4c70a0fea40d9f5390b3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:43.456583 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c6e773d4-fb70-440e-bc0d-0ab282167876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad23c2633ac4c70a0fea40d9f5390b3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:43.487346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 831/1681] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:32:42 2022] DELETE /identity/v3/users/cad23c2633ac4c70a0fea40d9f5390b3 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:43.492927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8789-ace5-4ea3-a607-ed3b072de094 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:43.494585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8789-ace5-4ea3-a607-ed3b072de094 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:43.495124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8789-ace5-4ea3-a607-ed3b072de094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:43.535914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e73d8789-ace5-4ea3-a607-ed3b072de094 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:43.538718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e73d8789-ace5-4ea3-a607-ed3b072de094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:43.641033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155318-4915-4c48-a553-0d35f625e706 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:43.641316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155318-4915-4c48-a553-0d35f625e706 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:43.641642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155318-4915-4c48-a553-0d35f625e706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:43.728562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:43.740147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e1155318-4915-4c48-a553-0d35f625e706 None None] MFA Rules not processed for user `3b8b820bb8ad4599837afad008daf413`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:43.741365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e1155318-4915-4c48-a553-0d35f625e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:43.807437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 851/1682] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:32:43.842781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d8789-ace5-4ea3-a607-ed3b072de094 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:43.846245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e73d8789-ace5-4ea3-a607-ed3b072de094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:44.038813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 832/1683] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:44.040350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7980b-2c00-4ab4-9384-15a40a5b452d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:44.040634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7980b-2c00-4ab4-9384-15a40a5b452d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:44.040907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7980b-2c00-4ab4-9384-15a40a5b452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:44.079770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d8789-ace5-4ea3-a607-ed3b072de094 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:44.090209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-12f7980b-2c00-4ab4-9384-15a40a5b452d None None] MFA Rules not processed for user `3b8b820bb8ad4599837afad008daf413`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:44.091465 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-12f7980b-2c00-4ab4-9384-15a40a5b452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:44.098858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628c71a-f829-4afd-be62-be60ec5a0f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:44.099728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628c71a-f829-4afd-be62-be60ec5a0f3e service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:44.100002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628c71a-f829-4afd-be62-be60ec5a0f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:44.100266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628c71a-f829-4afd-be62-be60ec5a0f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:44.135448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 833/1684] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:44.136624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7980b-2c00-4ab4-9384-15a40a5b452d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:44.150166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-12f7980b-2c00-4ab4-9384-15a40a5b452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:44.153621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628c71a-f829-4afd-be62-be60ec5a0f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:44.157117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628c71a-f829-4afd-be62-be60ec5a0f3e service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:44.186139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 852/1685] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:32:44.321960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:44.327920 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7980b-2c00-4ab4-9384-15a40a5b452d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:44.336638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080109-b75f-41ce-9564-3277589de8a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:44.337456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080109-b75f-41ce-9564-3277589de8a8 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:44.337866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080109-b75f-41ce-9564-3277589de8a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:44.338266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080109-b75f-41ce-9564-3277589de8a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:44.350327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c080109-b75f-41ce-9564-3277589de8a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:44.353168 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c080109-b75f-41ce-9564-3277589de8a8 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:44.390502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 834/1686] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:44 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:45.010790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628c71a-f829-4afd-be62-be60ec5a0f3e service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:45.012464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2628c71a-f829-4afd-be62-be60ec5a0f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:45.039268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c2905-7235-48e5-94ea-2717851184e9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:45.039796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c2905-7235-48e5-94ea-2717851184e9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:45.039868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c2905-7235-48e5-94ea-2717851184e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:45.051267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628c71a-f829-4afd-be62-be60ec5a0f3e service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:45.090424 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-995c2905-7235-48e5-94ea-2717851184e9 None None] MFA Rules not processed for user `deea84058f724ff3b78caa9d8b010202`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:45.091671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-995c2905-7235-48e5-94ea-2717851184e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:45.115764 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:45.119299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:45.119870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:45.120344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] PATH_INFO: `/v3/projects/d2cbf46d72284ccea45654fef46d0039` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:45.125163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2cbf46d72284ccea45654fef46d0039)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:45.130503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 04:32:45.130503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: warnings.warn(msg) Oct 06 04:32:45.130503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: Oct 06 04:32:45.141506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:45.330514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2cbf46d72284ccea45654fef46d0039', 'request_id': 'req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:45.349504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 835/1687] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:45.360258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfbc4b-5209-473e-be18-0292b52f4f49 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:45.360546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfbc4b-5209-473e-be18-0292b52f4f49 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:45.360809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfbc4b-5209-473e-be18-0292b52f4f49 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:45.361662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2cbf46d72284ccea45654fef46d0039', 'request_id': 'req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:45.362513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 836/1688] 10.222.0.20 () {54 vars in 912 bytes} [Thu Oct 6 04:32:45 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:32:45.370180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b5d12-fcfe-435e-9d8f-480227cf7136 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:45.370467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b5d12-fcfe-435e-9d8f-480227cf7136 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:45.370778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b5d12-fcfe-435e-9d8f-480227cf7136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:45.376123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2cbf46d72284ccea45654fef46d0039', 'request_id': 'req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:45.445069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a02b5d12-fcfe-435e-9d8f-480227cf7136 None None] MFA Rules not processed for user `39ca0a824c4740dbb911bb1a38cfc47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:45.446391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a02b5d12-fcfe-435e-9d8f-480227cf7136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:45.446501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] The token cache is being invalidate because project d2cbf46d72284ccea45654fef46d0039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:32:45.450718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:45.452753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac4060a-03ee-4a6f-ada2-d310c3b54b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:45.459911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 853/1689] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:32:45 2022] DELETE /identity/v3/projects/d2cbf46d72284ccea45654fef46d0039 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:45.462865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559291-7f3f-4b58-9cdf-415a39809501 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:45.463259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559291-7f3f-4b58-9cdf-415a39809501 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:45.466219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559291-7f3f-4b58-9cdf-415a39809501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:45.506107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a1559291-7f3f-4b58-9cdf-415a39809501 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:45.516010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a1559291-7f3f-4b58-9cdf-415a39809501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:45.715682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 854/1690] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:45.717713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1559291-7f3f-4b58-9cdf-415a39809501 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:45.718766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a1559291-7f3f-4b58-9cdf-415a39809501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:45.720310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 837/1691] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:32:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:45.737936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b342f7-9e31-4e8f-a5bc-74fef71b090d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:45.738254 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b342f7-9e31-4e8f-a5bc-74fef71b090d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:45.738864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b342f7-9e31-4e8f-a5bc-74fef71b090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:45.763543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:45.847161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-68b342f7-9e31-4e8f-a5bc-74fef71b090d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:45.860389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-68b342f7-9e31-4e8f-a5bc-74fef71b090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:45.913123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 838/1692] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:45.914161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b342f7-9e31-4e8f-a5bc-74fef71b090d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:45.917725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-68b342f7-9e31-4e8f-a5bc-74fef71b090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:45.989453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b342f7-9e31-4e8f-a5bc-74fef71b090d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:46.009004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469ef91-d717-4aba-9d5c-d8bc1fb402ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:46.009812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469ef91-d717-4aba-9d5c-d8bc1fb402ed service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:46.010186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469ef91-d717-4aba-9d5c-d8bc1fb402ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:46.010881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469ef91-d717-4aba-9d5c-d8bc1fb402ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:46.031752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469ef91-d717-4aba-9d5c-d8bc1fb402ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:46.033590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469ef91-d717-4aba-9d5c-d8bc1fb402ed service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:46.062256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 839/1693] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:46.063129 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469ef91-d717-4aba-9d5c-d8bc1fb402ed service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:46.096748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469ef91-d717-4aba-9d5c-d8bc1fb402ed service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:46.098547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1559291-7f3f-4b58-9cdf-415a39809501 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:46.126163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445dd5-9579-4b62-a8c5-993f46f875e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:46.126383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ace70-9494-473e-b558-35c643a3d4d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:46.126801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445dd5-9579-4b62-a8c5-993f46f875e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:46.126974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ace70-9494-473e-b558-35c643a3d4d5 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:46.127131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445dd5-9579-4b62-a8c5-993f46f875e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:46.127335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445dd5-9579-4b62-a8c5-993f46f875e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:46.127697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ace70-9494-473e-b558-35c643a3d4d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:46.128000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445dd5-9579-4b62-a8c5-993f46f875e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:46.128261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ace70-9494-473e-b558-35c643a3d4d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:46.128378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445dd5-9579-4b62-a8c5-993f46f875e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:46.132642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-422ace70-9494-473e-b558-35c643a3d4d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:46.133009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445dd5-9579-4b62-a8c5-993f46f875e2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:46.180155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 840/1694] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:32:46.186853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445dd5-9579-4b62-a8c5-993f46f875e2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:46.219371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445dd5-9579-4b62-a8c5-993f46f875e2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:46.242006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a91f2f-a7a2-4d37-a381-221c436c8455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:46.242568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a91f2f-a7a2-4d37-a381-221c436c8455 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:46.243452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a91f2f-a7a2-4d37-a381-221c436c8455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:46.243735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a91f2f-a7a2-4d37-a381-221c436c8455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:46.251441 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a91f2f-a7a2-4d37-a381-221c436c8455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:46.253869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a91f2f-a7a2-4d37-a381-221c436c8455 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:46.327218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 841/1695] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:46 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:46.330446 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fa347-2730-415b-9107-f2feab95f648 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:46.331687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fa347-2730-415b-9107-f2feab95f648 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:46.332165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fa347-2730-415b-9107-f2feab95f648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:46.346256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ace70-9494-473e-b558-35c643a3d4d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:46.355290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ace70-9494-473e-b558-35c643a3d4d5 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:46.391274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 855/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:46.392539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ace70-9494-473e-b558-35c643a3d4d5 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:46.403673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d44fa347-2730-415b-9107-f2feab95f648 None None] MFA Rules not processed for user `0a64dd6dfd6c478eaabb44f2d1614472`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:46.405360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d44fa347-2730-415b-9107-f2feab95f648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:46.421042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ace70-9494-473e-b558-35c643a3d4d5 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:46.442105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:46.529631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74312508-ae77-4405-9026-aeafd108f422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:46.530678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312508-ae77-4405-9026-aeafd108f422 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:46.531090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312508-ae77-4405-9026-aeafd108f422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:46.531551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312508-ae77-4405-9026-aeafd108f422 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:46.532492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74312508-ae77-4405-9026-aeafd108f422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:46.534635 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74312508-ae77-4405-9026-aeafd108f422 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:46.582672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 842/1697] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:46.592243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 856/1698] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:46 2022] POST /identity/v3/users => generated 303 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:46.596214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fa347-2730-415b-9107-f2feab95f648 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:46.610524 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fa347-2730-415b-9107-f2feab95f648 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:46.616730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7becd1-b29d-4153-b11a-466ca7fd7b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:46.617506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7becd1-b29d-4153-b11a-466ca7fd7b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:46.617781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7becd1-b29d-4153-b11a-466ca7fd7b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:46.618046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7becd1-b29d-4153-b11a-466ca7fd7b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:46.622195 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7becd1-b29d-4153-b11a-466ca7fd7b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:46.622195 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7becd1-b29d-4153-b11a-466ca7fd7b86 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:46.637223 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 843/1699] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:46.638310 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74312508-ae77-4405-9026-aeafd108f422 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:46.652060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74312508-ae77-4405-9026-aeafd108f422 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:46.662492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561e2cd-d363-4b97-aae9-e4d2ed087a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:46.663447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561e2cd-d363-4b97-aae9-e4d2ed087a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:46.664032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561e2cd-d363-4b97-aae9-e4d2ed087a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:46.664541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561e2cd-d363-4b97-aae9-e4d2ed087a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:46.666331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561e2cd-d363-4b97-aae9-e4d2ed087a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:46.669085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561e2cd-d363-4b97-aae9-e4d2ed087a0f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:46.688329 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7becd1-b29d-4153-b11a-466ca7fd7b86 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:46.700279 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7becd1-b29d-4153-b11a-466ca7fd7b86 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:46.700834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 857/1700] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:46.706950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b3a14-65aa-4857-b978-3cd81239d547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:46.708945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b3a14-65aa-4857-b978-3cd81239d547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:46.709490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b3a14-65aa-4857-b978-3cd81239d547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:46.709954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b3a14-65aa-4857-b978-3cd81239d547 admin admin] PATH_INFO: `/v3/projects/cb3c43bb87bc4fd7b3bbaea1d0ff5f18/users/c018837cf80c4d0e88e58894a642c620/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:46.729836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b3a14-65aa-4857-b978-3cd81239d547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3c43bb87bc4fd7b3bbaea1d0ff5f18, user_id=c018837cf80c4d0e88e58894a642c620, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:46.734285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b3a14-65aa-4857-b978-3cd81239d547 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:46.770120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 844/1701] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:46 2022] PUT /identity/v3/projects/cb3c43bb87bc4fd7b3bbaea1d0ff5f18/users/c018837cf80c4d0e88e58894a642c620/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:46.777419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc013410-06ce-4563-82af-b74847a360ab None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:46.777734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc013410-06ce-4563-82af-b74847a360ab None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:46.777961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc013410-06ce-4563-82af-b74847a360ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:46.879888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fc013410-06ce-4563-82af-b74847a360ab None None] MFA Rules not processed for user `c018837cf80c4d0e88e58894a642c620`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:46.881141 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fc013410-06ce-4563-82af-b74847a360ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:46.940120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:47.090536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b3a14-65aa-4857-b978-3cd81239d547 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:47.092550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a11b3a14-65aa-4857-b978-3cd81239d547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:47.151529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 858/1702] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:46 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:47.154997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc013410-06ce-4563-82af-b74847a360ab None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:47.289790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b3a14-65aa-4857-b978-3cd81239d547 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:47.317190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4c037-54d9-464b-979e-18bf13c8383a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:47.320920 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4c037-54d9-464b-979e-18bf13c8383a service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:47.321404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4c037-54d9-464b-979e-18bf13c8383a service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:47.323998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4c037-54d9-464b-979e-18bf13c8383a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:47.385252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc013410-06ce-4563-82af-b74847a360ab None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:47.399873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047f82b-4a38-43c7-8805-3e25f77d9285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:47.400617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047f82b-4a38-43c7-8805-3e25f77d9285 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:47.402039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047f82b-4a38-43c7-8805-3e25f77d9285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:47.402637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047f82b-4a38-43c7-8805-3e25f77d9285 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:47.403382 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047f82b-4a38-43c7-8805-3e25f77d9285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:47.429319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047f82b-4a38-43c7-8805-3e25f77d9285 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:47.496481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4c037-54d9-464b-979e-18bf13c8383a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:47.501173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4c037-54d9-464b-979e-18bf13c8383a service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:47.502807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 859/1703] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:47 2022] POST /identity/v3/projects => generated 403 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:47.506242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047f82b-4a38-43c7-8805-3e25f77d9285 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:47.510547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6047f82b-4a38-43c7-8805-3e25f77d9285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:47.558667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 845/1704] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:32:47.566645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d71254-7c20-4167-8b6a-019ea5b3c056 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:47.567710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d71254-7c20-4167-8b6a-019ea5b3c056 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:47.568364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d71254-7c20-4167-8b6a-019ea5b3c056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:47.642302 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-62d71254-7c20-4167-8b6a-019ea5b3c056 None None] MFA Rules not processed for user `3b8b820bb8ad4599837afad008daf413`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:47.647849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-62d71254-7c20-4167-8b6a-019ea5b3c056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:47.722127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:47.761332 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047f82b-4a38-43c7-8805-3e25f77d9285 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:47.796143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:47.796824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:47.797101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:47.797381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] PATH_INFO: `/v3/users/5f64be20c39e4abab065c2c9eb1cdeca` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:47.798788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f64be20c39e4abab065c2c9eb1cdeca)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:47.800745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:47.856036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 846/1705] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:47.857712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d71254-7c20-4167-8b6a-019ea5b3c056 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:47.890101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d71254-7c20-4167-8b6a-019ea5b3c056 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:47.890521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:47.901381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f64be20c39e4abab065c2c9eb1cdeca'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:47.901765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53185b-29f5-4b65-a419-c2078f8af516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:47.903223 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53185b-29f5-4b65-a419-c2078f8af516 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:47.904266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53185b-29f5-4b65-a419-c2078f8af516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:47.905723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53185b-29f5-4b65-a419-c2078f8af516 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:47.908096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53185b-29f5-4b65-a419-c2078f8af516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:47.920467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53185b-29f5-4b65-a419-c2078f8af516 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:47.921494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f64be20c39e4abab065c2c9eb1cdeca'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:47.948402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f64be20c39e4abab065c2c9eb1cdeca'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:47.951507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f64be20c39e4abab065c2c9eb1cdeca'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:47.968500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f64be20c39e4abab065c2c9eb1cdeca'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:47.978579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 847/1706] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:47 2022] POST /identity/v3/users => generated 308 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:47.981230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb4b7c-18e6-4c51-bd2f-ca7feed06afe None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:47.981653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb4b7c-18e6-4c51-bd2f-ca7feed06afe None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:47.985586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb4b7c-18e6-4c51-bd2f-ca7feed06afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:47.990787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 860/1707] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:32:47 2022] DELETE /identity/v3/users/5f64be20c39e4abab065c2c9eb1cdeca => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:47.994488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:48.000189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:48.134285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2ecb4b7c-18e6-4c51-bd2f-ca7feed06afe None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:48.136469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2ecb4b7c-18e6-4c51-bd2f-ca7feed06afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:48.206489 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fb0ab-7697-4aa6-801a-7675b8071a1d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:48.222167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64ecf1-c8b0-48be-8ddf-1a9a90a33ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:48.223733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ecf1-c8b0-48be-8ddf-1a9a90a33ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:48.224215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ecf1-c8b0-48be-8ddf-1a9a90a33ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:48.224613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ecf1-c8b0-48be-8ddf-1a9a90a33ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:48.226321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ecf1-c8b0-48be-8ddf-1a9a90a33ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:48.229783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ecf1-c8b0-48be-8ddf-1a9a90a33ce8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:48.266666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 861/1708] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:48.268832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669e8ad-a4a2-456f-98f9-728ba883232c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:48.278906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669e8ad-a4a2-456f-98f9-728ba883232c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:48.282014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669e8ad-a4a2-456f-98f9-728ba883232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:48.331576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0669e8ad-a4a2-456f-98f9-728ba883232c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:48.335784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0669e8ad-a4a2-456f-98f9-728ba883232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:48.358888 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 848/1709] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:32:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:48.361316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb4b7c-18e6-4c51-bd2f-ca7feed06afe None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:48.364317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 862/1710] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:48.368441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669e8ad-a4a2-456f-98f9-728ba883232c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:48.369935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2ecb4b7c-18e6-4c51-bd2f-ca7feed06afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:48.403828 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669e8ad-a4a2-456f-98f9-728ba883232c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:48.418180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606f8f3-114f-4285-9960-c5f097d3f088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:48.419115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606f8f3-114f-4285-9960-c5f097d3f088 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:48.419581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606f8f3-114f-4285-9960-c5f097d3f088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:48.420121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606f8f3-114f-4285-9960-c5f097d3f088 admin admin] PATH_INFO: `/v3/projects/1115149f42154787a411a0b385868a08/users/e46a853f43bc4376b2c22f358c46e963/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:48.443011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb4b7c-18e6-4c51-bd2f-ca7feed06afe None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:48.461128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606f8f3-114f-4285-9960-c5f097d3f088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1115149f42154787a411a0b385868a08, user_id=e46a853f43bc4376b2c22f358c46e963, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:48.465152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606f8f3-114f-4285-9960-c5f097d3f088 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:48.479457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:48.481091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:48.482253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:48.482838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] PATH_INFO: `/v3/users/d7cda20efa524612a206325e4c129e5d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:48.493328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7cda20efa524612a206325e4c129e5d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:48.503702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:48.504349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 863/1711] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:48 2022] PUT /identity/v3/projects/1115149f42154787a411a0b385868a08/users/e46a853f43bc4376b2c22f358c46e963/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:48.509705 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606f8f3-114f-4285-9960-c5f097d3f088 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:48.511921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0606f8f3-114f-4285-9960-c5f097d3f088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:48.645700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7cda20efa524612a206325e4c129e5d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:48.647047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7cda20efa524612a206325e4c129e5d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:48.666993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7cda20efa524612a206325e4c129e5d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:48.672799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606f8f3-114f-4285-9960-c5f097d3f088 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:48.690700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd81bbe-4d25-4f09-8c07-b0cd40c877a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:48.691380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81bbe-4d25-4f09-8c07-b0cd40c877a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:48.691661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81bbe-4d25-4f09-8c07-b0cd40c877a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:48.694506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7cda20efa524612a206325e4c129e5d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:48.707420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7cda20efa524612a206325e4c129e5d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:48.707625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81bbe-4d25-4f09-8c07-b0cd40c877a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:48.709962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:48.721125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-afd81bbe-4d25-4f09-8c07-b0cd40c877a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:48.747518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 849/1712] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:32:48 2022] DELETE /identity/v3/users/d7cda20efa524612a206325e4c129e5d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:48.751401 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:48.760373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:48.897642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:48.967621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd81bbe-4d25-4f09-8c07-b0cd40c877a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:48.970921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd81bbe-4d25-4f09-8c07-b0cd40c877a8 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:48.986932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9d68-1070-438e-97be-3d32e5fcfe20 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:48.999075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe07ec2-def4-4624-a226-84e33af87cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:49.001208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe07ec2-def4-4624-a226-84e33af87cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:49.001826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe07ec2-def4-4624-a226-84e33af87cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:49.004442 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe07ec2-def4-4624-a226-84e33af87cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:49.007126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe07ec2-def4-4624-a226-84e33af87cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:49.010472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 864/1713] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:49.011458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd81bbe-4d25-4f09-8c07-b0cd40c877a8 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:49.013205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-afd81bbe-4d25-4f09-8c07-b0cd40c877a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:49.015650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe07ec2-def4-4624-a226-84e33af87cd6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:49.037943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 850/1714] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:49.037943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bb0d6-6d4a-4b6c-8007-97c5feedeadd None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:49.037943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bb0d6-6d4a-4b6c-8007-97c5feedeadd None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:49.037943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bb0d6-6d4a-4b6c-8007-97c5feedeadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:49.069341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4e7bb0d6-6d4a-4b6c-8007-97c5feedeadd None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:49.070881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4e7bb0d6-6d4a-4b6c-8007-97c5feedeadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:49.086364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 851/1715] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:49.087913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bb0d6-6d4a-4b6c-8007-97c5feedeadd None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:49.133313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bb0d6-6d4a-4b6c-8007-97c5feedeadd None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:49.148121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273df28d-f7f1-4bd9-8d0c-1631f7fb3acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:49.151186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273df28d-f7f1-4bd9-8d0c-1631f7fb3acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:49.152025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273df28d-f7f1-4bd9-8d0c-1631f7fb3acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:49.152589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273df28d-f7f1-4bd9-8d0c-1631f7fb3acd admin admin] PATH_INFO: `/v3/projects/1115149f42154787a411a0b385868a08/users/e46a853f43bc4376b2c22f358c46e963/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:49.158489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273df28d-f7f1-4bd9-8d0c-1631f7fb3acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1115149f42154787a411a0b385868a08, user_id=e46a853f43bc4376b2c22f358c46e963, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:49.166475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273df28d-f7f1-4bd9-8d0c-1631f7fb3acd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:49.205274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 852/1716] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:49 2022] PUT /identity/v3/projects/1115149f42154787a411a0b385868a08/users/e46a853f43bc4376b2c22f358c46e963/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:49.214376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273df28d-f7f1-4bd9-8d0c-1631f7fb3acd admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:49.214376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-273df28d-f7f1-4bd9-8d0c-1631f7fb3acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:49.333015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd81bbe-4d25-4f09-8c07-b0cd40c877a8 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:49.333532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273df28d-f7f1-4bd9-8d0c-1631f7fb3acd admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:49.360218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2a4c1-ca5b-4d2a-b43f-72b4726b112e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:49.361190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2a4c1-ca5b-4d2a-b43f-72b4726b112e service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:49.361682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2a4c1-ca5b-4d2a-b43f-72b4726b112e service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:49.367348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2a4c1-ca5b-4d2a-b43f-72b4726b112e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:49.529165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2a4c1-ca5b-4d2a-b43f-72b4726b112e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:49.531594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2a4c1-ca5b-4d2a-b43f-72b4726b112e service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:49.536626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b713e0-48b6-4619-83de-c80d0c4751ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:49.537592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b713e0-48b6-4619-83de-c80d0c4751ee service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:49.537940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b713e0-48b6-4619-83de-c80d0c4751ee service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:49.539525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b713e0-48b6-4619-83de-c80d0c4751ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:49.545867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d3b713e0-48b6-4619-83de-c80d0c4751ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:49.562613 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 853/1717] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:49.567736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a7248-4b5e-4b09-bbc0-d48fa6d1f783 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:49.569863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a7248-4b5e-4b09-bbc0-d48fa6d1f783 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:49.570412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a7248-4b5e-4b09-bbc0-d48fa6d1f783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:49.640236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c26a7248-4b5e-4b09-bbc0-d48fa6d1f783 None None] MFA Rules not processed for user `e46a853f43bc4376b2c22f358c46e963`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:49.642135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c26a7248-4b5e-4b09-bbc0-d48fa6d1f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:49.669597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:49.679532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b713e0-48b6-4619-83de-c80d0c4751ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:49.681594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b713e0-48b6-4619-83de-c80d0c4751ee service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:49.688984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:49.718564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 865/1718] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:32:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:32:49.835613 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 854/1719] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:49 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:49.855771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b713e0-48b6-4619-83de-c80d0c4751ee service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:49.858043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d3b713e0-48b6-4619-83de-c80d0c4751ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:50.038759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b713e0-48b6-4619-83de-c80d0c4751ee service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:50.046019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e400d-e01b-4669-869f-6d97c69b98e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:50.046876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e400d-e01b-4669-869f-6d97c69b98e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:50.047368 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e400d-e01b-4669-869f-6d97c69b98e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:50.047929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e400d-e01b-4669-869f-6d97c69b98e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:50.064501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e400d-e01b-4669-869f-6d97c69b98e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:50.067265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e400d-e01b-4669-869f-6d97c69b98e1 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:50.104284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 866/1720] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:49 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:50.544792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a7248-4b5e-4b09-bbc0-d48fa6d1f783 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:50.563790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a7248-4b5e-4b09-bbc0-d48fa6d1f783 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:50.593759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:50.599194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:50.599695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:50.599799 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] PATH_INFO: `/v3/users/c018837cf80c4d0e88e58894a642c620` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:50.605510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c018837cf80c4d0e88e58894a642c620)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:50.613694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:50.735804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c018837cf80c4d0e88e58894a642c620'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:50.737265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c018837cf80c4d0e88e58894a642c620'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:50.758570 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c018837cf80c4d0e88e58894a642c620'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:50.809271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c018837cf80c4d0e88e58894a642c620'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:50.828919 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c018837cf80c4d0e88e58894a642c620'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:50.849461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 855/1721] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:32:50 2022] DELETE /identity/v3/users/c018837cf80c4d0e88e58894a642c620 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:50.850839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5c3f9-c789-450d-86b1-2c0541b1f47d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:50.851370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5c3f9-c789-450d-86b1-2c0541b1f47d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:50.851457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5c3f9-c789-450d-86b1-2c0541b1f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:50.919987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-73f5c3f9-c789-450d-86b1-2c0541b1f47d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:50.923614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-73f5c3f9-c789-450d-86b1-2c0541b1f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:51.125833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 867/1722] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:51.914490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:51.919874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:52.206773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67386d44-df6f-4a75-8d8d-ef043bd2b7b6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:52.207516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67386d44-df6f-4a75-8d8d-ef043bd2b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:52.207516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67386d44-df6f-4a75-8d8d-ef043bd2b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:52.255823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-67386d44-df6f-4a75-8d8d-ef043bd2b7b6 None None] MFA Rules not processed for user `39ca0a824c4740dbb911bb1a38cfc47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:52.256527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f6dca-36df-485e-9c94-a06614234b41 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:52.260028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-67386d44-df6f-4a75-8d8d-ef043bd2b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:52.272199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f3a9c-1cfe-404b-8d42-f1307aa480f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:52.272901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3a9c-1cfe-404b-8d42-f1307aa480f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:52.273296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3a9c-1cfe-404b-8d42-f1307aa480f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:52.273580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3a9c-1cfe-404b-8d42-f1307aa480f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:52.295764 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 868/1723] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Oct 6 04:32:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:52.316887 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f3a9c-1cfe-404b-8d42-f1307aa480f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:52.320717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f3a9c-1cfe-404b-8d42-f1307aa480f4 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:52.352933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 856/1724] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:32:52.527661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67386d44-df6f-4a75-8d8d-ef043bd2b7b6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:52.551653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67386d44-df6f-4a75-8d8d-ef043bd2b7b6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:52.564523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d8034-f012-4152-bf69-a384e49d6b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:52.565400 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8034-f012-4152-bf69-a384e49d6b15 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:52.565874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8034-f012-4152-bf69-a384e49d6b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:52.577612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8034-f012-4152-bf69-a384e49d6b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:52.622671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d8034-f012-4152-bf69-a384e49d6b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:52.636774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d8034-f012-4152-bf69-a384e49d6b15 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:52.700188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 869/1725] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:53.455864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f3a9c-1cfe-404b-8d42-f1307aa480f4 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:53.457904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-895f3a9c-1cfe-404b-8d42-f1307aa480f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:53.494418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f3a9c-1cfe-404b-8d42-f1307aa480f4 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:53.520727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:53.521598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:53.521888 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:53.522181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] PATH_INFO: `/v3/projects/f592f9757154462c898a01afbcf14d0d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:53.529771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f592f9757154462c898a01afbcf14d0d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:53.531953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:53.611504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:53.672369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f592f9757154462c898a01afbcf14d0d', 'request_id': 'req-115d498f-1123-49c1-9725-d4752e0a7f7f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:53.687936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f592f9757154462c898a01afbcf14d0d', 'request_id': 'req-115d498f-1123-49c1-9725-d4752e0a7f7f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:53.696550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f592f9757154462c898a01afbcf14d0d', 'request_id': 'req-115d498f-1123-49c1-9725-d4752e0a7f7f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:53.725293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] The token cache is being invalidate because project f592f9757154462c898a01afbcf14d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:32:53.725714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:53.726652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-115d498f-1123-49c1-9725-d4752e0a7f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:53.729222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 857/1726] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:32:53 2022] DELETE /identity/v3/projects/f592f9757154462c898a01afbcf14d0d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:53.734578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9b18-775a-4b0a-8f52-570ac21284e1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:53.735887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9b18-775a-4b0a-8f52-570ac21284e1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:53.736361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9b18-775a-4b0a-8f52-570ac21284e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:53.769626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-870f9b18-775a-4b0a-8f52-570ac21284e1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:53.773255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-870f9b18-775a-4b0a-8f52-570ac21284e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:54.061573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 870/1727] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:54.064326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce63bd-cefc-48d4-bf00-335954d7a194 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:54.064746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce63bd-cefc-48d4-bf00-335954d7a194 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:54.065029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce63bd-cefc-48d4-bf00-335954d7a194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:54.132837 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1fce63bd-cefc-48d4-bf00-335954d7a194 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:54.145134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1fce63bd-cefc-48d4-bf00-335954d7a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:54.162117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 858/1728] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:54.163863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f9b18-775a-4b0a-8f52-570ac21284e1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:54.181527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f9b18-775a-4b0a-8f52-570ac21284e1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:54.194624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142574-035e-4bf0-89b8-1b56b7a440dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:54.218276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142574-035e-4bf0-89b8-1b56b7a440dd admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:54.218614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142574-035e-4bf0-89b8-1b56b7a440dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:54.218978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142574-035e-4bf0-89b8-1b56b7a440dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:54.219689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142574-035e-4bf0-89b8-1b56b7a440dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:54.225090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142574-035e-4bf0-89b8-1b56b7a440dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:54.226590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce63bd-cefc-48d4-bf00-335954d7a194 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:54.230156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1fce63bd-cefc-48d4-bf00-335954d7a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:54.234630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142574-035e-4bf0-89b8-1b56b7a440dd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:54.263355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce63bd-cefc-48d4-bf00-335954d7a194 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:54.292189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:54.299094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:54.300007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:54.300500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] PATH_INFO: `/v3/projects/c7a9e1d0b8c04e5eb307a2122fcec019` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:54.302574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a9e1d0b8c04e5eb307a2122fcec019)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:54.305161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:54.325951 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 871/1729] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:32:54.329239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142574-035e-4bf0-89b8-1b56b7a440dd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:54.397738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142574-035e-4bf0-89b8-1b56b7a440dd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:54.424121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd556a8c-4e0b-4115-87e3-5c7087ef1cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:54.424773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556a8c-4e0b-4115-87e3-5c7087ef1cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:54.425054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556a8c-4e0b-4115-87e3-5c7087ef1cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:54.425337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556a8c-4e0b-4115-87e3-5c7087ef1cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:54.425974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd556a8c-4e0b-4115-87e3-5c7087ef1cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:54.427921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd556a8c-4e0b-4115-87e3-5c7087ef1cb3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:54.457894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:54.544909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a9e1d0b8c04e5eb307a2122fcec019', 'request_id': 'req-ff80db62-822d-4252-85c0-231aef27d366'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:54.553447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 872/1730] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:54 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:54.554547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd556a8c-4e0b-4115-87e3-5c7087ef1cb3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:54.561965 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a9e1d0b8c04e5eb307a2122fcec019', 'request_id': 'req-ff80db62-822d-4252-85c0-231aef27d366'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:54.571454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a9e1d0b8c04e5eb307a2122fcec019', 'request_id': 'req-ff80db62-822d-4252-85c0-231aef27d366'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:54.598863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] The token cache is being invalidate because project c7a9e1d0b8c04e5eb307a2122fcec019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:32:54.599972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:54.603120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:54.608790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 859/1731] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:32:54 2022] DELETE /identity/v3/projects/c7a9e1d0b8c04e5eb307a2122fcec019 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:54.609692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:54.611109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:54.803225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80db62-822d-4252-85c0-231aef27d366 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:54.829723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd556a8c-4e0b-4115-87e3-5c7087ef1cb3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:54.850387 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c74d4-8c21-4f0e-bf12-4c9897132474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:54.851449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c74d4-8c21-4f0e-bf12-4c9897132474 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:54.851866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c74d4-8c21-4f0e-bf12-4c9897132474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:54.855772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c74d4-8c21-4f0e-bf12-4c9897132474 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:54.856685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c74d4-8c21-4f0e-bf12-4c9897132474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:54.859375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c74d4-8c21-4f0e-bf12-4c9897132474 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:54.903709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:54.914778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 873/1732] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:54 2022] POST /identity/v3/users => generated 288 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:54.919111 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c74d4-8c21-4f0e-bf12-4c9897132474 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:54.923630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-716c74d4-8c21-4f0e-bf12-4c9897132474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:54.959063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c74d4-8c21-4f0e-bf12-4c9897132474 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:54.980972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39483497-458f-4e97-b7ab-df64d88cf0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:54.982694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39483497-458f-4e97-b7ab-df64d88cf0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:54.983218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39483497-458f-4e97-b7ab-df64d88cf0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:54.983714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39483497-458f-4e97-b7ab-df64d88cf0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:54.985379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39483497-458f-4e97-b7ab-df64d88cf0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:54.987710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39483497-458f-4e97-b7ab-df64d88cf0a5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:55.000219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:55.000778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:55.001051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:55.001320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] PATH_INFO: `/v3/users/7655793f4cbb4f95b83f91b8a27d02a4` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:55.002502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7655793f4cbb4f95b83f91b8a27d02a4)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:55.004466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:55.018227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 874/1733] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:55.023675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39483497-458f-4e97-b7ab-df64d88cf0a5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:55.052985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39483497-458f-4e97-b7ab-df64d88cf0a5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:55.068530 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a850e-7a99-4d40-a932-7cbc58854c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:55.069484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a850e-7a99-4d40-a932-7cbc58854c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:55.069910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a850e-7a99-4d40-a932-7cbc58854c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:55.070328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a850e-7a99-4d40-a932-7cbc58854c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:55.071132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a850e-7a99-4d40-a932-7cbc58854c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:55.073762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a850e-7a99-4d40-a932-7cbc58854c83 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:55.094390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7655793f4cbb4f95b83f91b8a27d02a4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:55.095684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7655793f4cbb4f95b83f91b8a27d02a4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:55.099724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 875/1734] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:55.108537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a850e-7a99-4d40-a932-7cbc58854c83 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:55.112065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-874a850e-7a99-4d40-a932-7cbc58854c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:55.123250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7655793f4cbb4f95b83f91b8a27d02a4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:55.133923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a850e-7a99-4d40-a932-7cbc58854c83 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:55.147909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc68b5-1955-47b0-b2c8-2dcbbdfe7ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:55.152238 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc68b5-1955-47b0-b2c8-2dcbbdfe7ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:55.152804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc68b5-1955-47b0-b2c8-2dcbbdfe7ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:55.153259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc68b5-1955-47b0-b2c8-2dcbbdfe7ac5 admin admin] PATH_INFO: `/v3/projects/ec2e5754856a46a5af1643bace79bb82/users/9fab7912d81c4d73a503b8cd7a69dcdd/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:55.155238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7655793f4cbb4f95b83f91b8a27d02a4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:55.172097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69f178af-baf8-40a9-aa1c-a10e5a21bebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7655793f4cbb4f95b83f91b8a27d02a4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:55.188674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc68b5-1955-47b0-b2c8-2dcbbdfe7ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2e5754856a46a5af1643bace79bb82, user_id=9fab7912d81c4d73a503b8cd7a69dcdd, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:55.194012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 860/1735] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:32:54 2022] DELETE /identity/v3/users/7655793f4cbb4f95b83f91b8a27d02a4 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:55.195283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc68b5-1955-47b0-b2c8-2dcbbdfe7ac5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:55.224589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 876/1736] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:55 2022] PUT /identity/v3/projects/ec2e5754856a46a5af1643bace79bb82/users/9fab7912d81c4d73a503b8cd7a69dcdd/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:55.235809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4348-96f0-4cf2-8103-e73c2386f023 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:55.236505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4348-96f0-4cf2-8103-e73c2386f023 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:55.237018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4348-96f0-4cf2-8103-e73c2386f023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:55.346140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6efd4348-96f0-4cf2-8103-e73c2386f023 None None] MFA Rules not processed for user `9fab7912d81c4d73a503b8cd7a69dcdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:55.347422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6efd4348-96f0-4cf2-8103-e73c2386f023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:55.627439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 861/1737] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:55.628909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc68b5-1955-47b0-b2c8-2dcbbdfe7ac5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:55.848070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc68b5-1955-47b0-b2c8-2dcbbdfe7ac5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:55.871690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05c66a-d25a-4ec6-8c63-fa841ac5f325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:55.872327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c66a-d25a-4ec6-8c63-fa841ac5f325 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:55.872601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c66a-d25a-4ec6-8c63-fa841ac5f325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:55.872867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c66a-d25a-4ec6-8c63-fa841ac5f325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:55.873512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05c66a-d25a-4ec6-8c63-fa841ac5f325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:55.875467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05c66a-d25a-4ec6-8c63-fa841ac5f325 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:55.938392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 877/1738] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:55 2022] POST /identity/v3/projects => generated 377 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:55.942567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd4348-96f0-4cf2-8103-e73c2386f023 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:55.962439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd4348-96f0-4cf2-8103-e73c2386f023 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:56.219739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:56.268250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40729e26-e751-42ee-8fe1-32e0c4a0904d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:56.268538 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40729e26-e751-42ee-8fe1-32e0c4a0904d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:56.268815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40729e26-e751-42ee-8fe1-32e0c4a0904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:56.279632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3160178-d0a0-44a7-823a-939763990eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:56.280567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160178-d0a0-44a7-823a-939763990eea admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:56.280992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160178-d0a0-44a7-823a-939763990eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:56.282423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160178-d0a0-44a7-823a-939763990eea admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:56.283213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3160178-d0a0-44a7-823a-939763990eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:56.287542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3160178-d0a0-44a7-823a-939763990eea admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:56.332897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-40729e26-e751-42ee-8fe1-32e0c4a0904d None None] MFA Rules not processed for user `deea84058f724ff3b78caa9d8b010202`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:56.334206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-40729e26-e751-42ee-8fe1-32e0c4a0904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:56.363199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 862/1739] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:55 2022] POST /identity/v3/users => generated 295 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:56.367335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:56.369029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa70b-9051-4e3a-8f06-eb38d02a01fd None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:56.370426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa70b-9051-4e3a-8f06-eb38d02a01fd None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:56.372892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa70b-9051-4e3a-8f06-eb38d02a01fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:56.437106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2aaaa70b-9051-4e3a-8f06-eb38d02a01fd None None] MFA Rules not processed for user `0a64dd6dfd6c478eaabb44f2d1614472`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:56.442530 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2aaaa70b-9051-4e3a-8f06-eb38d02a01fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:56.518056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 878/1740] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:56.519079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40729e26-e751-42ee-8fe1-32e0c4a0904d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:56.574591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40729e26-e751-42ee-8fe1-32e0c4a0904d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:56.596761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2d914-04f3-469b-af9e-2e9379b3c18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:56.597411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2d914-04f3-469b-af9e-2e9379b3c18f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:56.597690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2d914-04f3-469b-af9e-2e9379b3c18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:56.597960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2d914-04f3-469b-af9e-2e9379b3c18f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:56.598642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2d914-04f3-469b-af9e-2e9379b3c18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:56.600280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2d914-04f3-469b-af9e-2e9379b3c18f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:56.619108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 863/1741] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:56.631676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa70b-9051-4e3a-8f06-eb38d02a01fd None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:56.634978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2aaaa70b-9051-4e3a-8f06-eb38d02a01fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:56.652032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 879/1742] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:56.652317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2d914-04f3-469b-af9e-2e9379b3c18f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:56.662037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa70b-9051-4e3a-8f06-eb38d02a01fd None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:56.669184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:56.670104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:56.670607 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:56.671030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] PATH_INFO: `/v3/projects/cb3c43bb87bc4fd7b3bbaea1d0ff5f18` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:56.674906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb3c43bb87bc4fd7b3bbaea1d0ff5f18)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:56.678852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:56.685080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2d914-04f3-469b-af9e-2e9379b3c18f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:56.717759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7d266-3e0b-4a8d-bad7-5ac907a38d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:56.718450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7d266-3e0b-4a8d-bad7-5ac907a38d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:56.718726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7d266-3e0b-4a8d-bad7-5ac907a38d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:56.718992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7d266-3e0b-4a8d-bad7-5ac907a38d73 admin admin] PATH_INFO: `/v3/projects/840f8566ee4f44708ba15531744ec810/users/28cd9175b16e470ca4983babb454acd7/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:56.746042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7d266-3e0b-4a8d-bad7-5ac907a38d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840f8566ee4f44708ba15531744ec810, user_id=28cd9175b16e470ca4983babb454acd7, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:56.748990 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7d266-3e0b-4a8d-bad7-5ac907a38d73 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:56.786579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 880/1743] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:56 2022] PUT /identity/v3/projects/840f8566ee4f44708ba15531744ec810/users/28cd9175b16e470ca4983babb454acd7/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:56.791195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7d266-3e0b-4a8d-bad7-5ac907a38d73 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:56.794462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3c43bb87bc4fd7b3bbaea1d0ff5f18', 'request_id': 'req-3f7071bc-0d12-41ea-85c9-8a6de018facf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:56.818736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3c43bb87bc4fd7b3bbaea1d0ff5f18', 'request_id': 'req-3f7071bc-0d12-41ea-85c9-8a6de018facf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:56.845371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3c43bb87bc4fd7b3bbaea1d0ff5f18', 'request_id': 'req-3f7071bc-0d12-41ea-85c9-8a6de018facf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:56.888562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] The token cache is being invalidate because project cb3c43bb87bc4fd7b3bbaea1d0ff5f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:32:56.889705 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:56.897404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:56.903660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 864/1744] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:32:56 2022] DELETE /identity/v3/projects/cb3c43bb87bc4fd7b3bbaea1d0ff5f18 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:56.907760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:56.909623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:56.995210 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7d266-3e0b-4a8d-bad7-5ac907a38d73 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:57.014555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689f53a-035f-4b71-9b60-0e3efef672c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:57.015635 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689f53a-035f-4b71-9b60-0e3efef672c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:57.016750 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689f53a-035f-4b71-9b60-0e3efef672c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:57.017224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689f53a-035f-4b71-9b60-0e3efef672c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:57.018124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689f53a-035f-4b71-9b60-0e3efef672c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:57.028038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689f53a-035f-4b71-9b60-0e3efef672c4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:57.052229 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 881/1745] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:57.055536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689f53a-035f-4b71-9b60-0e3efef672c4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:57.066415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4689f53a-035f-4b71-9b60-0e3efef672c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:57.096758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689f53a-035f-4b71-9b60-0e3efef672c4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:57.109773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:57.116218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39888660-3319-4b34-b849-d81c0bdb2113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:57.117106 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39888660-3319-4b34-b849-d81c0bdb2113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:57.118712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39888660-3319-4b34-b849-d81c0bdb2113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:57.119208 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39888660-3319-4b34-b849-d81c0bdb2113 admin admin] PATH_INFO: `/v3/projects/840f8566ee4f44708ba15531744ec810/users/28cd9175b16e470ca4983babb454acd7/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:57.121619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7071bc-0d12-41ea-85c9-8a6de018facf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:57.123897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39888660-3319-4b34-b849-d81c0bdb2113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840f8566ee4f44708ba15531744ec810, user_id=28cd9175b16e470ca4983babb454acd7, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:57.131836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:57.133786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:57.134311 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:57.134424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39888660-3319-4b34-b849-d81c0bdb2113 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:57.134914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] PATH_INFO: `/v3/users/e46a853f43bc4376b2c22f358c46e963` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:57.136965 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46a853f43bc4376b2c22f358c46e963)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:57.140474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:57.173544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 882/1746] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:32:57 2022] PUT /identity/v3/projects/840f8566ee4f44708ba15531744ec810/users/28cd9175b16e470ca4983babb454acd7/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:32:57.173753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57bc88-273c-450a-82b7-545bf4847cb7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:57.174128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57bc88-273c-450a-82b7-545bf4847cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:57.174597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57bc88-273c-450a-82b7-545bf4847cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:57.248575 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aa57bc88-273c-450a-82b7-545bf4847cb7 None None] MFA Rules not processed for user `28cd9175b16e470ca4983babb454acd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:57.249632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aa57bc88-273c-450a-82b7-545bf4847cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:57.330453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46a853f43bc4376b2c22f358c46e963'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:57.331136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46a853f43bc4376b2c22f358c46e963'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:57.335466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:57.358557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46a853f43bc4376b2c22f358c46e963'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:57.369273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 883/1747] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:57.382488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57bc88-273c-450a-82b7-545bf4847cb7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:57.384929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aa57bc88-273c-450a-82b7-545bf4847cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:57.402743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46a853f43bc4376b2c22f358c46e963'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:57.436389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46a853f43bc4376b2c22f358c46e963'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:57.455962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 865/1748] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:32:56 2022] DELETE /identity/v3/users/e46a853f43bc4376b2c22f358c46e963 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:57.680413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57bc88-273c-450a-82b7-545bf4847cb7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:57.822447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16c171-f46f-4181-88d3-78dc2e8b038a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:57.823352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16c171-f46f-4181-88d3-78dc2e8b038a service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:57.823806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16c171-f46f-4181-88d3-78dc2e8b038a service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:57.824218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16c171-f46f-4181-88d3-78dc2e8b038a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:57.836630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7e16c171-f46f-4181-88d3-78dc2e8b038a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:58.042583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16c171-f46f-4181-88d3-78dc2e8b038a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:58.044440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16c171-f46f-4181-88d3-78dc2e8b038a service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:58.062371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 884/1749] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:32:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:32:58.198750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:58.200615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:58.388828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833797-7170-4cbe-8d1f-c25feac29816 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:58.400972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:58.400972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:58.400972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:58.400972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] PATH_INFO: `/v3/projects/8a1767d62e20490ab8767bcef1c145eb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:58.401433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1767d62e20490ab8767bcef1c145eb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:58.422386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:58.608227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1767d62e20490ab8767bcef1c145eb', 'request_id': 'req-7866ca62-5532-49b2-90ad-9c76d1e49b8e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:58.622667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1767d62e20490ab8767bcef1c145eb', 'request_id': 'req-7866ca62-5532-49b2-90ad-9c76d1e49b8e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:58.661966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1767d62e20490ab8767bcef1c145eb', 'request_id': 'req-7866ca62-5532-49b2-90ad-9c76d1e49b8e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:58.700892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] The token cache is being invalidate because project 8a1767d62e20490ab8767bcef1c145eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:32:58.701173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:58.702029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7866ca62-5532-49b2-90ad-9c76d1e49b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:32:58.708479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 866/1750] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:32:58 2022] DELETE /identity/v3/projects/8a1767d62e20490ab8767bcef1c145eb => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:32:58.709854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d46802-85fc-4b42-bd50-0ec3f054f7ba None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:58.710381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d46802-85fc-4b42-bd50-0ec3f054f7ba None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:58.710998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d46802-85fc-4b42-bd50-0ec3f054f7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:58.789693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-43d46802-85fc-4b42-bd50-0ec3f054f7ba None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:58.797960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-43d46802-85fc-4b42-bd50-0ec3f054f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:59.037965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 885/1751] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:32:59.044186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efa340-4ada-45da-88d5-420a96dd03e6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:59.044331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efa340-4ada-45da-88d5-420a96dd03e6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:59.044587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efa340-4ada-45da-88d5-420a96dd03e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:59.109883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:59.121128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-64efa340-4ada-45da-88d5-420a96dd03e6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:59.122381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-64efa340-4ada-45da-88d5-420a96dd03e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:59.138295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 867/1752] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:32:59.139420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d46802-85fc-4b42-bd50-0ec3f054f7ba None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:59.153065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:59.168327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d46802-85fc-4b42-bd50-0ec3f054f7ba None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:59.199126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68973354-e1ee-47fa-8614-b7d94a55ecfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:59.204549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68973354-e1ee-47fa-8614-b7d94a55ecfd admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:59.224074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68973354-e1ee-47fa-8614-b7d94a55ecfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:59.230943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68973354-e1ee-47fa-8614-b7d94a55ecfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:59.232442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68973354-e1ee-47fa-8614-b7d94a55ecfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:32:59.236761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68973354-e1ee-47fa-8614-b7d94a55ecfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:59.249926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68973354-e1ee-47fa-8614-b7d94a55ecfd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:59.309485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 886/1753] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:32:59.316945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efa340-4ada-45da-88d5-420a96dd03e6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:59.339868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efa340-4ada-45da-88d5-420a96dd03e6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:59.366090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a79cc-b37d-47ee-aeda-efb730e34176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:59.366733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a79cc-b37d-47ee-aeda-efb730e34176 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:59.367012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a79cc-b37d-47ee-aeda-efb730e34176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:59.367278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a79cc-b37d-47ee-aeda-efb730e34176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:59.370793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a79cc-b37d-47ee-aeda-efb730e34176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:59.381906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a79cc-b37d-47ee-aeda-efb730e34176 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:59.495277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68973354-e1ee-47fa-8614-b7d94a55ecfd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:59.505060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 868/1754] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:32:59 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:59.526273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68973354-e1ee-47fa-8614-b7d94a55ecfd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:59.683008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67740e0-2d17-4be0-828f-0d9d2f51640e None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:59.683008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67740e0-2d17-4be0-828f-0d9d2f51640e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:59.683194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67740e0-2d17-4be0-828f-0d9d2f51640e None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:59.684959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 869/1755] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:32:59.692661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3443d3-a4aa-4ee0-b7dd-cd8fc1f3fe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:59.693290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3443d3-a4aa-4ee0-b7dd-cd8fc1f3fe80 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:59.693562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3443d3-a4aa-4ee0-b7dd-cd8fc1f3fe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:59.693921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3443d3-a4aa-4ee0-b7dd-cd8fc1f3fe80 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:59.714578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3443d3-a4aa-4ee0-b7dd-cd8fc1f3fe80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:59.720338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3443d3-a4aa-4ee0-b7dd-cd8fc1f3fe80 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:59.796108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67740e0-2d17-4be0-828f-0d9d2f51640e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:59.808365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 887/1756] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:32:59 2022] POST /identity/v3/users => generated 291 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:32:59.843172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67740e0-2d17-4be0-828f-0d9d2f51640e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:59.844756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0fd8d-0a66-4b0d-9ad9-479fc1efd30e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:59.845087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0fd8d-0a66-4b0d-9ad9-479fc1efd30e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:59.845485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0fd8d-0a66-4b0d-9ad9-479fc1efd30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:59.853580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f138047-a53e-448f-b4c2-9712b2f1cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:59.854231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f138047-a53e-448f-b4c2-9712b2f1cc64 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:59.854572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f138047-a53e-448f-b4c2-9712b2f1cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:59.855181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f138047-a53e-448f-b4c2-9712b2f1cc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:59.858787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f138047-a53e-448f-b4c2-9712b2f1cc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:59.861880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f138047-a53e-448f-b4c2-9712b2f1cc64 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:32:59.895835 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 870/1757] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:32:59.901220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f138047-a53e-448f-b4c2-9712b2f1cc64 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:32:59.903975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f2a0fd8d-0a66-4b0d-9ad9-479fc1efd30e None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:32:59.905888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f2a0fd8d-0a66-4b0d-9ad9-479fc1efd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:32:59.940789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f138047-a53e-448f-b4c2-9712b2f1cc64 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:32:59.963297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d5e77-9573-4f56-9810-5de1b0a6123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:32:59.964049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d5e77-9573-4f56-9810-5de1b0a6123f admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:32:59.964313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d5e77-9573-4f56-9810-5de1b0a6123f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:32:59.964735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d5e77-9573-4f56-9810-5de1b0a6123f admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:32:59.965562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d5e77-9573-4f56-9810-5de1b0a6123f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:32:59.967189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d5e77-9573-4f56-9810-5de1b0a6123f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:00.029214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 871/1758] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:00.030261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d5e77-9573-4f56-9810-5de1b0a6123f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:00.066957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d5e77-9573-4f56-9810-5de1b0a6123f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:00.078731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948594cf-b730-4a1f-b000-cb851866e385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:00.079443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948594cf-b730-4a1f-b000-cb851866e385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:00.079718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948594cf-b730-4a1f-b000-cb851866e385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:00.079989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948594cf-b730-4a1f-b000-cb851866e385 admin admin] PATH_INFO: `/v3/projects/afb24bc30d9f4933b363a390eefe0565/users/30a9327ad88c4f64b84a41ba00d0c55e/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:00.145888 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948594cf-b730-4a1f-b000-cb851866e385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb24bc30d9f4933b363a390eefe0565, user_id=30a9327ad88c4f64b84a41ba00d0c55e, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:00.157410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948594cf-b730-4a1f-b000-cb851866e385 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:00.174278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 888/1759] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:32:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:00.176077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0fd8d-0a66-4b0d-9ad9-479fc1efd30e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:00.194107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f2a0fd8d-0a66-4b0d-9ad9-479fc1efd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:00.209148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 872/1760] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:00 2022] PUT /identity/v3/projects/afb24bc30d9f4933b363a390eefe0565/users/30a9327ad88c4f64b84a41ba00d0c55e/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:00.229001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e060112-591d-4429-af59-f9f1ffe8435a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:00.229288 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e060112-591d-4429-af59-f9f1ffe8435a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:00.229679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e060112-591d-4429-af59-f9f1ffe8435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:00.241122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0fd8d-0a66-4b0d-9ad9-479fc1efd30e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:00.412676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0e060112-591d-4429-af59-f9f1ffe8435a None None] MFA Rules not processed for user `30a9327ad88c4f64b84a41ba00d0c55e`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:00.413964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:00.414639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:00.415290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0e060112-591d-4429-af59-f9f1ffe8435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:00.420767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:00.421031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] PATH_INFO: `/v3/projects/1115149f42154787a411a0b385868a08` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:00.422321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1115149f42154787a411a0b385868a08)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:00.426704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:00.498327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:00.600825 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1115149f42154787a411a0b385868a08', 'request_id': 'req-2b3a2458-08a6-49b7-9385-a1188e0411ed'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:00.633921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1115149f42154787a411a0b385868a08', 'request_id': 'req-2b3a2458-08a6-49b7-9385-a1188e0411ed'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:00.659872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1115149f42154787a411a0b385868a08', 'request_id': 'req-2b3a2458-08a6-49b7-9385-a1188e0411ed'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:00.676737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] The token cache is being invalidate because project 1115149f42154787a411a0b385868a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:00.677295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:00.679406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b3a2458-08a6-49b7-9385-a1188e0411ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:00.681179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 889/1761] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:00 2022] DELETE /identity/v3/projects/1115149f42154787a411a0b385868a08 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:00.686120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b412-cf0a-4c32-b707-09d1f1b8ed11 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:00.686685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b412-cf0a-4c32-b707-09d1f1b8ed11 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:00.687093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b412-cf0a-4c32-b707-09d1f1b8ed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:00.722044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5aa1b412-cf0a-4c32-b707-09d1f1b8ed11 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:00.723984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5aa1b412-cf0a-4c32-b707-09d1f1b8ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:00.751444 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 873/1762] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:00.754138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e060112-591d-4429-af59-f9f1ffe8435a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:00.758258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0e060112-591d-4429-af59-f9f1ffe8435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:00.819369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e060112-591d-4429-af59-f9f1ffe8435a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:00.997155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 890/1763] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:01.004001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f51bb-3198-4ce0-a775-f1f1a0aaa48d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:01.004393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f51bb-3198-4ce0-a775-f1f1a0aaa48d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:01.005138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f51bb-3198-4ce0-a775-f1f1a0aaa48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:01.071398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c34f51bb-3198-4ce0-a775-f1f1a0aaa48d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:01.076972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c34f51bb-3198-4ce0-a775-f1f1a0aaa48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:01.080767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76735e8e-aaee-4672-8610-d0eec6f4306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:01.081463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76735e8e-aaee-4672-8610-d0eec6f4306d admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:01.081741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76735e8e-aaee-4672-8610-d0eec6f4306d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:01.082010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76735e8e-aaee-4672-8610-d0eec6f4306d admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:01.082655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76735e8e-aaee-4672-8610-d0eec6f4306d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:01.104175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 891/1764] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:01.107400 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76735e8e-aaee-4672-8610-d0eec6f4306d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:01.109969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f51bb-3198-4ce0-a775-f1f1a0aaa48d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:01.157625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f51bb-3198-4ce0-a775-f1f1a0aaa48d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:01.188038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad82fa-ee9f-4280-9e36-e69a3124690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:01.190772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad82fa-ee9f-4280-9e36-e69a3124690a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:01.193674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad82fa-ee9f-4280-9e36-e69a3124690a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:01.196170 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad82fa-ee9f-4280-9e36-e69a3124690a admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:01.197313 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad82fa-ee9f-4280-9e36-e69a3124690a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:01.213614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad82fa-ee9f-4280-9e36-e69a3124690a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:01.228155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad82fa-ee9f-4280-9e36-e69a3124690a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:01.240598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 874/1765] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:00 2022] POST /identity/v3/projects => generated 381 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:01.247248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76735e8e-aaee-4672-8610-d0eec6f4306d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:01.284424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 892/1766] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:01.288954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad82fa-ee9f-4280-9e36-e69a3124690a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:01.302494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:01.327005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad82fa-ee9f-4280-9e36-e69a3124690a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:01.549760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658adf8c-5c73-4c03-9920-6f2838d60ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:01.550523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658adf8c-5c73-4c03-9920-6f2838d60ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:01.551894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658adf8c-5c73-4c03-9920-6f2838d60ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:01.555520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658adf8c-5c73-4c03-9920-6f2838d60ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:01.556466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658adf8c-5c73-4c03-9920-6f2838d60ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:01.561915 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76735e8e-aaee-4672-8610-d0eec6f4306d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:01.563470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658adf8c-5c73-4c03-9920-6f2838d60ac3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:01.587863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca110362-ac0e-4ef7-8bbb-8f221a79ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:01.588807 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110362-ac0e-4ef7-8bbb-8f221a79ddae admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:01.589481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110362-ac0e-4ef7-8bbb-8f221a79ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:01.589961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110362-ac0e-4ef7-8bbb-8f221a79ddae admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:01.591169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca110362-ac0e-4ef7-8bbb-8f221a79ddae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:01.603082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca110362-ac0e-4ef7-8bbb-8f221a79ddae admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:01.672737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 875/1767] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:01 2022] POST /identity/v3/users => generated 297 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:01.674396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbf026-e715-4e5a-8e07-ce61ad4be514 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:01.675777 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbf026-e715-4e5a-8e07-ce61ad4be514 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:01.676192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbf026-e715-4e5a-8e07-ce61ad4be514 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:01.680187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 876/1768] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:33:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:33:01.682996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbf026-e715-4e5a-8e07-ce61ad4be514 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:01.692646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 893/1769] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:01 2022] POST /identity/v3/projects => generated 391 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:01.694314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658adf8c-5c73-4c03-9920-6f2838d60ac3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:01.740963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:01.873854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658adf8c-5c73-4c03-9920-6f2838d60ac3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:01.880129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730a16d-aa6d-4a44-bb0b-281ce8efff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:01.881174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730a16d-aa6d-4a44-bb0b-281ce8efff74 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:01.881600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730a16d-aa6d-4a44-bb0b-281ce8efff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:01.882100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730a16d-aa6d-4a44-bb0b-281ce8efff74 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:01.882886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730a16d-aa6d-4a44-bb0b-281ce8efff74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:01.885098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730a16d-aa6d-4a44-bb0b-281ce8efff74 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:01.945675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 894/1770] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:01 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:01.946813 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730a16d-aa6d-4a44-bb0b-281ce8efff74 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:01.956898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b730a16d-aa6d-4a44-bb0b-281ce8efff74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:02.035422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbf026-e715-4e5a-8e07-ce61ad4be514 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:02.056287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddba6b7-a5c8-49e1-b70e-4f7536501e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:02.060241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba6b7-a5c8-49e1-b70e-4f7536501e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:02.060568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba6b7-a5c8-49e1-b70e-4f7536501e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:02.060843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba6b7-a5c8-49e1-b70e-4f7536501e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:02.061529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddba6b7-a5c8-49e1-b70e-4f7536501e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:02.087723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddba6b7-a5c8-49e1-b70e-4f7536501e00 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:02.088142 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730a16d-aa6d-4a44-bb0b-281ce8efff74 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:02.094747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a186020-f41a-4790-a128-5208fd888f54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:02.095422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186020-f41a-4790-a128-5208fd888f54 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:02.095698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186020-f41a-4790-a128-5208fd888f54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:02.095990 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186020-f41a-4790-a128-5208fd888f54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:02.101008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1a186020-f41a-4790-a128-5208fd888f54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:02.162160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 877/1771] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:02.165715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e513946-7410-444b-8410-8aaf121a6c89 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:02.166861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e513946-7410-444b-8410-8aaf121a6c89 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:02.167732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e513946-7410-444b-8410-8aaf121a6c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:02.247000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6e513946-7410-444b-8410-8aaf121a6c89 None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:02.248773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6e513946-7410-444b-8410-8aaf121a6c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:02.294294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a186020-f41a-4790-a128-5208fd888f54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:02.300156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a186020-f41a-4790-a128-5208fd888f54 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:02.349810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 895/1772] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:02.352015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a186020-f41a-4790-a128-5208fd888f54 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:02.379272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a186020-f41a-4790-a128-5208fd888f54 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:02.397092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ed20-e6e1-4b26-8d89-37757d5a8766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:02.397735 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ed20-e6e1-4b26-8d89-37757d5a8766 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:02.398001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ed20-e6e1-4b26-8d89-37757d5a8766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:02.398268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ed20-e6e1-4b26-8d89-37757d5a8766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:02.398917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47ed20-e6e1-4b26-8d89-37757d5a8766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:02.400562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47ed20-e6e1-4b26-8d89-37757d5a8766 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:02.425785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 896/1773] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:02.426765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ed20-e6e1-4b26-8d89-37757d5a8766 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:02.446817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ed20-e6e1-4b26-8d89-37757d5a8766 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:02.461281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cdfe9-40fe-4078-b5ca-c281deefdcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:02.461895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cdfe9-40fe-4078-b5ca-c281deefdcf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:02.462172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cdfe9-40fe-4078-b5ca-c281deefdcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:02.462440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cdfe9-40fe-4078-b5ca-c281deefdcf1 admin admin] PATH_INFO: `/v3/projects/2d1741f82f1c4e0d8a11f7891a6e375b/users/54f4af24f52f45d4ab7ba39f609c2187/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:02.495531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cdfe9-40fe-4078-b5ca-c281deefdcf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1741f82f1c4e0d8a11f7891a6e375b, user_id=54f4af24f52f45d4ab7ba39f609c2187, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:02.500500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cdfe9-40fe-4078-b5ca-c281deefdcf1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:02.539393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 897/1774] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:02 2022] PUT /identity/v3/projects/2d1741f82f1c4e0d8a11f7891a6e375b/users/54f4af24f52f45d4ab7ba39f609c2187/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:02.544802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cdfe9-40fe-4078-b5ca-c281deefdcf1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:02.552614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-748cdfe9-40fe-4078-b5ca-c281deefdcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:02.564370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 878/1775] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:33:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:02.568392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e513946-7410-444b-8410-8aaf121a6c89 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:02.580504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:02.592280 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e513946-7410-444b-8410-8aaf121a6c89 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:02.679038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:02.719771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cdfe9-40fe-4078-b5ca-c281deefdcf1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:02.732813 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d69ade-d494-4be2-8c42-66b77b8db907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:02.733458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d69ade-d494-4be2-8c42-66b77b8db907 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:02.733725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d69ade-d494-4be2-8c42-66b77b8db907 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:02.733991 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d69ade-d494-4be2-8c42-66b77b8db907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:02.744279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-63d69ade-d494-4be2-8c42-66b77b8db907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:02.771540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d69ade-d494-4be2-8c42-66b77b8db907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:02.772963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d69ade-d494-4be2-8c42-66b77b8db907 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:02.811267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 898/1776] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:02.812331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d69ade-d494-4be2-8c42-66b77b8db907 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:02.921934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ace291-95f8-4d7f-b21a-07c91236e3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:02.928398 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ace291-95f8-4d7f-b21a-07c91236e3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:02.931639 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ace291-95f8-4d7f-b21a-07c91236e3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:02.933484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ace291-95f8-4d7f-b21a-07c91236e3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:02.936132 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ace291-95f8-4d7f-b21a-07c91236e3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:02.947513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ace291-95f8-4d7f-b21a-07c91236e3a0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:03.035750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 879/1777] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:03.037009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ace291-95f8-4d7f-b21a-07c91236e3a0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:03.090257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ace291-95f8-4d7f-b21a-07c91236e3a0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:03.130371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93bef-518f-403b-8290-5b7805ef7087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:03.131062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93bef-518f-403b-8290-5b7805ef7087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:03.131353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93bef-518f-403b-8290-5b7805ef7087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:03.131638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93bef-518f-403b-8290-5b7805ef7087 admin admin] PATH_INFO: `/v3/projects/00366a8343ae4cb28a63617d673e960f/users/cf8ad4f39e6443ba83ced976b30d4b67/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:03.230371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a93bef-518f-403b-8290-5b7805ef7087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00366a8343ae4cb28a63617d673e960f, user_id=cf8ad4f39e6443ba83ced976b30d4b67, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:03.233106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a93bef-518f-403b-8290-5b7805ef7087 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:03.249927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d69ade-d494-4be2-8c42-66b77b8db907 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:03.265913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45c690-708e-44f1-84ea-7ffbb49b5eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:03.267989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45c690-708e-44f1-84ea-7ffbb49b5eed admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:03.277512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45c690-708e-44f1-84ea-7ffbb49b5eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:03.278003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45c690-708e-44f1-84ea-7ffbb49b5eed admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:03.280123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45c690-708e-44f1-84ea-7ffbb49b5eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:03.284645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45c690-708e-44f1-84ea-7ffbb49b5eed admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:03.295333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 880/1778] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:03 2022] PUT /identity/v3/projects/00366a8343ae4cb28a63617d673e960f/users/cf8ad4f39e6443ba83ced976b30d4b67/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:03.299436 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93bef-518f-403b-8290-5b7805ef7087 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:03.345722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 899/1779] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:03.353925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9205b8-d0db-4724-9130-c200eccba74b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:03.354762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9205b8-d0db-4724-9130-c200eccba74b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:03.360958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9205b8-d0db-4724-9130-c200eccba74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:03.456094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2e9205b8-d0db-4724-9130-c200eccba74b None None] MFA Rules not processed for user `cf8ad4f39e6443ba83ced976b30d4b67`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:03.460042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2e9205b8-d0db-4724-9130-c200eccba74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:03.546190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93bef-518f-403b-8290-5b7805ef7087 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:03.553535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6bc4a-7546-4e4f-87df-7bd45d304648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:03.554336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6bc4a-7546-4e4f-87df-7bd45d304648 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:03.554738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6bc4a-7546-4e4f-87df-7bd45d304648 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:03.555330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6bc4a-7546-4e4f-87df-7bd45d304648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:03.568908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6bc4a-7546-4e4f-87df-7bd45d304648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:03.573492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6bc4a-7546-4e4f-87df-7bd45d304648 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:03.610670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 881/1780] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:03.611708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6bc4a-7546-4e4f-87df-7bd45d304648 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:03.675645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 900/1781] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:03.677076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9205b8-d0db-4724-9130-c200eccba74b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:03.791755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:03.902196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6bc4a-7546-4e4f-87df-7bd45d304648 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:03.915037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6c0bf-1ab0-4383-84a1-f1fe64c903a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:03.915941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6c0bf-1ab0-4383-84a1-f1fe64c903a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:03.916294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6c0bf-1ab0-4383-84a1-f1fe64c903a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:03.916646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6c0bf-1ab0-4383-84a1-f1fe64c903a3 admin admin] PATH_INFO: `/v3/projects/2d1741f82f1c4e0d8a11f7891a6e375b/users/54f4af24f52f45d4ab7ba39f609c2187/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:03.918943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6c0bf-1ab0-4383-84a1-f1fe64c903a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1741f82f1c4e0d8a11f7891a6e375b, user_id=54f4af24f52f45d4ab7ba39f609c2187, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:03.921763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6c0bf-1ab0-4383-84a1-f1fe64c903a3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:03.926687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9205b8-d0db-4724-9130-c200eccba74b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:03.936783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 882/1782] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:03 2022] PUT /identity/v3/projects/2d1741f82f1c4e0d8a11f7891a6e375b/users/54f4af24f52f45d4ab7ba39f609c2187/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:03.947488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4113a5f-99c6-4ea3-8bcb-ace28fd87aea None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:03.947888 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4113a5f-99c6-4ea3-8bcb-ace28fd87aea None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:03.948320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4113a5f-99c6-4ea3-8bcb-ace28fd87aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:04.005612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f4113a5f-99c6-4ea3-8bcb-ace28fd87aea None None] MFA Rules not processed for user `54f4af24f52f45d4ab7ba39f609c2187`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:04.007467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f4113a5f-99c6-4ea3-8bcb-ace28fd87aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:04.013341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:04.156366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba854-8c9f-4eed-809a-a4eb7db4e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:04.160280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba854-8c9f-4eed-809a-a4eb7db4e178 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:04.160814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba854-8c9f-4eed-809a-a4eb7db4e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:04.161076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba854-8c9f-4eed-809a-a4eb7db4e178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:04.161758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ba854-8c9f-4eed-809a-a4eb7db4e178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:04.168012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ba854-8c9f-4eed-809a-a4eb7db4e178 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:04.244678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 901/1783] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:03 2022] POST /identity/v3/projects => generated 393 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:04.248612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba854-8c9f-4eed-809a-a4eb7db4e178 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:04.270440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 883/1784] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:04.326714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4113a5f-99c6-4ea3-8bcb-ace28fd87aea None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:04.334572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f4113a5f-99c6-4ea3-8bcb-ace28fd87aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:04.462335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba854-8c9f-4eed-809a-a4eb7db4e178 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:04.488887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6b7a-09e4-430d-b3b3-f5796c205799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:04.489441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6b7a-09e4-430d-b3b3-f5796c205799 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:04.489712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6b7a-09e4-430d-b3b3-f5796c205799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:04.489984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6b7a-09e4-430d-b3b3-f5796c205799 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:04.490636 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6b7a-09e4-430d-b3b3-f5796c205799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:04.499404 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6b7a-09e4-430d-b3b3-f5796c205799 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:04.521695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4113a5f-99c6-4ea3-8bcb-ace28fd87aea None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:04.575753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 902/1785] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:04 2022] POST /identity/v3/users => generated 303 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:04.576656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6b7a-09e4-430d-b3b3-f5796c205799 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:04.607001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6b7a-09e4-430d-b3b3-f5796c205799 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:04.620582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7159c92-9e90-4892-8a34-6c61450e2bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:04.621439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7159c92-9e90-4892-8a34-6c61450e2bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:04.621851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7159c92-9e90-4892-8a34-6c61450e2bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:04.622270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7159c92-9e90-4892-8a34-6c61450e2bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:04.623066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7159c92-9e90-4892-8a34-6c61450e2bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:04.624857 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7159c92-9e90-4892-8a34-6c61450e2bfd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:04.684009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 903/1786] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:04.685027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7159c92-9e90-4892-8a34-6c61450e2bfd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:04.706206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7159c92-9e90-4892-8a34-6c61450e2bfd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:04.728527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcdc48-3e78-4a7b-a815-169c89453c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:04.729248 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcdc48-3e78-4a7b-a815-169c89453c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:04.729721 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcdc48-3e78-4a7b-a815-169c89453c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:04.730002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcdc48-3e78-4a7b-a815-169c89453c2c admin admin] PATH_INFO: `/v3/projects/6174778d5fba460294d7d77cc73e4d0f/users/29bc2c5fefac4a7899693f8c5c4f3ac6/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:04.758749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb551ea-c3b1-4417-b474-8e8ede9eaf3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:04.760117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb551ea-c3b1-4417-b474-8e8ede9eaf3f service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:04.760604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb551ea-c3b1-4417-b474-8e8ede9eaf3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:04.761415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb551ea-c3b1-4417-b474-8e8ede9eaf3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:04.792209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcdc48-3e78-4a7b-a815-169c89453c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6174778d5fba460294d7d77cc73e4d0f, user_id=29bc2c5fefac4a7899693f8c5c4f3ac6, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:04.794930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcdc48-3e78-4a7b-a815-169c89453c2c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:04.822520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 904/1787] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:04 2022] PUT /identity/v3/projects/6174778d5fba460294d7d77cc73e4d0f/users/29bc2c5fefac4a7899693f8c5c4f3ac6/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:04.826761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcdc48-3e78-4a7b-a815-169c89453c2c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:04.856707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:05.030345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcdc48-3e78-4a7b-a815-169c89453c2c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:05.057533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffe71c-f54a-490d-81e3-a2a9cc8228ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:05.057819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb551ea-c3b1-4417-b474-8e8ede9eaf3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:05.058211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffe71c-f54a-490d-81e3-a2a9cc8228ab admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:05.058489 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffe71c-f54a-490d-81e3-a2a9cc8228ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:05.058756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffe71c-f54a-490d-81e3-a2a9cc8228ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:05.060034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb551ea-c3b1-4417-b474-8e8ede9eaf3f service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:05.064040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffe71c-f54a-490d-81e3-a2a9cc8228ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:05.065887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffe71c-f54a-490d-81e3-a2a9cc8228ab admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:05.102035 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 905/1788] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:05.103018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffe71c-f54a-490d-81e3-a2a9cc8228ab admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:05.137044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffe71c-f54a-490d-81e3-a2a9cc8228ab admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:05.152859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 884/1789] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 847 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:05.153493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f673bb-fdd1-439b-bba8-c1594fc4b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:05.154275 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f673bb-fdd1-439b-bba8-c1594fc4b233 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:05.154482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f673bb-fdd1-439b-bba8-c1594fc4b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:05.154736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f673bb-fdd1-439b-bba8-c1594fc4b233 admin admin] PATH_INFO: `/v3/projects/6174778d5fba460294d7d77cc73e4d0f/users/29bc2c5fefac4a7899693f8c5c4f3ac6/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:05.162512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f673bb-fdd1-439b-bba8-c1594fc4b233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6174778d5fba460294d7d77cc73e4d0f, user_id=29bc2c5fefac4a7899693f8c5c4f3ac6, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:05.165269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f673bb-fdd1-439b-bba8-c1594fc4b233 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:05.211823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 906/1790] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:05 2022] PUT /identity/v3/projects/6174778d5fba460294d7d77cc73e4d0f/users/29bc2c5fefac4a7899693f8c5c4f3ac6/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:05.214197 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b49ba-344e-4ff8-8fe1-198d59d91650 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:05.214488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b49ba-344e-4ff8-8fe1-198d59d91650 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:05.214765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b49ba-344e-4ff8-8fe1-198d59d91650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:05.252210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:05.344368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e73b49ba-344e-4ff8-8fe1-198d59d91650 None None] MFA Rules not processed for user `29bc2c5fefac4a7899693f8c5c4f3ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:05.345635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e73b49ba-344e-4ff8-8fe1-198d59d91650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:05.599547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 885/1791] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:05.759781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f673bb-fdd1-439b-bba8-c1594fc4b233 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:05.868568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f673bb-fdd1-439b-bba8-c1594fc4b233 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:05.878842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf9519-232d-489e-b7ca-44ca3694c915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:05.879513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf9519-232d-489e-b7ca-44ca3694c915 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:05.879788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf9519-232d-489e-b7ca-44ca3694c915 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:05.880057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf9519-232d-489e-b7ca-44ca3694c915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:05.916383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf9519-232d-489e-b7ca-44ca3694c915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:05.918272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf9519-232d-489e-b7ca-44ca3694c915 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:05.951570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 907/1792] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:06.106445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b49ba-344e-4ff8-8fe1-198d59d91650 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:06.124353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b49ba-344e-4ff8-8fe1-198d59d91650 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:06.139660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4baa4-8560-462d-88ec-cccc7bf48140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:06.140462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4baa4-8560-462d-88ec-cccc7bf48140 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:06.140957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4baa4-8560-462d-88ec-cccc7bf48140 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:06.141296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4baa4-8560-462d-88ec-cccc7bf48140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:06.168514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf9519-232d-489e-b7ca-44ca3694c915 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:06.263771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4baa4-8560-462d-88ec-cccc7bf48140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:06.266815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4baa4-8560-462d-88ec-cccc7bf48140 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:06.280893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 886/1793] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:06.295323 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf9519-232d-489e-b7ca-44ca3694c915 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:06.310407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d79130-eef0-4361-bbf4-82dae286578d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f4af24f52f45d4ab7ba39f609c2187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1741f82f1c4e0d8a11f7891a6e375b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:06.311297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d79130-eef0-4361-bbf4-82dae286578d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:06.311796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d79130-eef0-4361-bbf4-82dae286578d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:06.312250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d79130-eef0-4361-bbf4-82dae286578d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:06.313105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d79130-eef0-4361-bbf4-82dae286578d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:06.313593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d79130-eef0-4361-bbf4-82dae286578d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:06.315421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d79130-eef0-4361-bbf4-82dae286578d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:06.348876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 908/1794] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:06.350241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4baa4-8560-462d-88ec-cccc7bf48140 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:06.375873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4baa4-8560-462d-88ec-cccc7bf48140 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:06.382259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aae2b-dd1a-463b-8d11-a18866c797ee tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f4af24f52f45d4ab7ba39f609c2187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1741f82f1c4e0d8a11f7891a6e375b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:06.383445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aae2b-dd1a-463b-8d11-a18866c797ee tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:06.383986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aae2b-dd1a-463b-8d11-a18866c797ee tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:06.384962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aae2b-dd1a-463b-8d11-a18866c797ee tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:06.386143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aae2b-dd1a-463b-8d11-a18866c797ee tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:06.389055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aae2b-dd1a-463b-8d11-a18866c797ee tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:06.435175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 887/1795] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:06 2022] POST /identity/v3/projects => generated 354 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:06.439101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d79130-eef0-4361-bbf4-82dae286578d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:06.452587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d79130-eef0-4361-bbf4-82dae286578d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:06.540212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:06.601329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f51e3-954a-4503-8459-c9c2d5b6429d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f4af24f52f45d4ab7ba39f609c2187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1741f82f1c4e0d8a11f7891a6e375b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:06.602137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f51e3-954a-4503-8459-c9c2d5b6429d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:06.602605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f51e3-954a-4503-8459-c9c2d5b6429d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:06.603032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f51e3-954a-4503-8459-c9c2d5b6429d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:06.603932 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f51e3-954a-4503-8459-c9c2d5b6429d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:06.604450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f51e3-954a-4503-8459-c9c2d5b6429d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:06.607703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f51e3-954a-4503-8459-c9c2d5b6429d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:06.626026 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 909/1796] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:06.675416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aae2b-dd1a-463b-8d11-a18866c797ee tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:06.688205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aae2b-dd1a-463b-8d11-a18866c797ee tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:06.695784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f4af24f52f45d4ab7ba39f609c2187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1741f82f1c4e0d8a11f7891a6e375b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:06.697132 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:06.697479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:06.698169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] PATH_INFO: `/v3/projects/10a7f8caa4674bc0afabb5e9e628ba4a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:06.700918 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10a7f8caa4674bc0afabb5e9e628ba4a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:06.704361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:06.783149 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a7f8caa4674bc0afabb5e9e628ba4a', 'request_id': 'req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:06.801703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a7f8caa4674bc0afabb5e9e628ba4a', 'request_id': 'req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:06.812590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:06.816913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a7f8caa4674bc0afabb5e9e628ba4a', 'request_id': 'req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:06.840175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] The token cache is being invalidate because project 10a7f8caa4674bc0afabb5e9e628ba4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:06.840618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:06.841293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9cfe33b1-0471-4a6e-a8cd-5b45e0db5a25 tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:06.846573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 888/1797] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:06 2022] DELETE /identity/v3/projects/10a7f8caa4674bc0afabb5e9e628ba4a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:07.056691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f51e3-954a-4503-8459-c9c2d5b6429d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:07.058645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-900f51e3-954a-4503-8459-c9c2d5b6429d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:07.131553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f51e3-954a-4503-8459-c9c2d5b6429d tempest-VolumeQuotaClassesTest-1221905256 tempest-VolumeQuotaClassesTest-1221905256-project-admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:07.206165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:07.206979 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:07.207324 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:07.207707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] PATH_INFO: `/v3/users/30a9327ad88c4f64b84a41ba00d0c55e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:07.209059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a9327ad88c4f64b84a41ba00d0c55e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:07.211227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:07.290178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a9327ad88c4f64b84a41ba00d0c55e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:07.299785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a9327ad88c4f64b84a41ba00d0c55e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:07.316509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a9327ad88c4f64b84a41ba00d0c55e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:07.317228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a9327ad88c4f64b84a41ba00d0c55e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:07.319727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:07.330255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a9327ad88c4f64b84a41ba00d0c55e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:07.337919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 910/1798] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:07 2022] DELETE /identity/v3/users/30a9327ad88c4f64b84a41ba00d0c55e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:07.343538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd350a-2c69-4cbc-8976-15f904340cc1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:07.344047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd350a-2c69-4cbc-8976-15f904340cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:07.344152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd350a-2c69-4cbc-8976-15f904340cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:07.366582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-67dd350a-2c69-4cbc-8976-15f904340cc1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:07.367827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-67dd350a-2c69-4cbc-8976-15f904340cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:07.447153 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 889/1799] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:07.457848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:07.459417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:07.524155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3d86e-6999-4aee-af8c-efda817e51af admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:07.528419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40823569-7dc4-4451-9dd5-56adbf14ac83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:07.529082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40823569-7dc4-4451-9dd5-56adbf14ac83 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:07.529302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40823569-7dc4-4451-9dd5-56adbf14ac83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:07.529568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40823569-7dc4-4451-9dd5-56adbf14ac83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:07.540302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40823569-7dc4-4451-9dd5-56adbf14ac83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:07.542916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40823569-7dc4-4451-9dd5-56adbf14ac83 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:07.559657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 911/1800] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:08.353163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd350a-2c69-4cbc-8976-15f904340cc1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:08.354677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-67dd350a-2c69-4cbc-8976-15f904340cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:08.372754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd350a-2c69-4cbc-8976-15f904340cc1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:08.380153 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:08.381090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:08.381537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:08.381971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] PATH_INFO: `/v3/projects/afb24bc30d9f4933b363a390eefe0565` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:08.391092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb24bc30d9f4933b363a390eefe0565)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:08.396014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:08.483812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb24bc30d9f4933b363a390eefe0565', 'request_id': 'req-a50102b1-a47b-4c8f-aa1b-942b97424b1c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:08.508811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb24bc30d9f4933b363a390eefe0565', 'request_id': 'req-a50102b1-a47b-4c8f-aa1b-942b97424b1c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:08.521323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb24bc30d9f4933b363a390eefe0565', 'request_id': 'req-a50102b1-a47b-4c8f-aa1b-942b97424b1c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:08.537786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] The token cache is being invalidate because project afb24bc30d9f4933b363a390eefe0565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:08.538230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:08.538902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:08.541134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 890/1801] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:08 2022] DELETE /identity/v3/projects/afb24bc30d9f4933b363a390eefe0565 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:08.551916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40823569-7dc4-4451-9dd5-56adbf14ac83 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:08.562101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40823569-7dc4-4451-9dd5-56adbf14ac83 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:08.626891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:08.627697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:08.628072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:08.628457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] PATH_INFO: `/v3/users/54f4af24f52f45d4ab7ba39f609c2187` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:08.630119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f4af24f52f45d4ab7ba39f609c2187)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:08.633727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:08.717090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f4af24f52f45d4ab7ba39f609c2187'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:08.732878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f4af24f52f45d4ab7ba39f609c2187'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:08.755134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f4af24f52f45d4ab7ba39f609c2187'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:08.756097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f4af24f52f45d4ab7ba39f609c2187'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:08.764811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9d847249-bdf0-442c-b9c9-a406c822ff8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f4af24f52f45d4ab7ba39f609c2187'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:08.771679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 912/1802] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:08 2022] DELETE /identity/v3/users/54f4af24f52f45d4ab7ba39f609c2187 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:09.204605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:09.206266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:09.221967 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50102b1-a47b-4c8f-aa1b-942b97424b1c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:09.286046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:09.286867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:09.287334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:09.287688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] PATH_INFO: `/v3/projects/2d1741f82f1c4e0d8a11f7891a6e375b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:09.289051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1741f82f1c4e0d8a11f7891a6e375b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:09.291393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:09.316642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:09.353772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1741f82f1c4e0d8a11f7891a6e375b', 'request_id': 'req-2654035b-9083-4b1c-865e-7e22e6ded8ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:09.362806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1741f82f1c4e0d8a11f7891a6e375b', 'request_id': 'req-2654035b-9083-4b1c-865e-7e22e6ded8ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:09.370237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1741f82f1c4e0d8a11f7891a6e375b', 'request_id': 'req-2654035b-9083-4b1c-865e-7e22e6ded8ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:09.382921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] The token cache is being invalidate because project 2d1741f82f1c4e0d8a11f7891a6e375b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:09.383322 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:09.384094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2654035b-9083-4b1c-865e-7e22e6ded8ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:09.386487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 891/1803] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:09 2022] DELETE /identity/v3/projects/2d1741f82f1c4e0d8a11f7891a6e375b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:09.391867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cebbe0-1af8-46bb-a66a-78f21dacc5aa None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:09.392152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cebbe0-1af8-46bb-a66a-78f21dacc5aa None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:09.392424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cebbe0-1af8-46bb-a66a-78f21dacc5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:09.414669 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-74cebbe0-1af8-46bb-a66a-78f21dacc5aa None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:09.415919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-74cebbe0-1af8-46bb-a66a-78f21dacc5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:09.425249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:09.489801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 913/1804] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:09.499412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1799-35af-4179-9bdd-965303bbfac4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:09.499692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1799-35af-4179-9bdd-965303bbfac4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:09.500731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1799-35af-4179-9bdd-965303bbfac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:09.521579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c05d1799-35af-4179-9bdd-965303bbfac4 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:09.522801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c05d1799-35af-4179-9bdd-965303bbfac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:09.531392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 892/1805] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:09.535531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cebbe0-1af8-46bb-a66a-78f21dacc5aa None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:09.546188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cebbe0-1af8-46bb-a66a-78f21dacc5aa None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:09.550868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1fe96-0321-43e6-a8e7-d2ed4b619548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:09.551592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1fe96-0321-43e6-a8e7-d2ed4b619548 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:09.551939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1fe96-0321-43e6-a8e7-d2ed4b619548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:09.552513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1fe96-0321-43e6-a8e7-d2ed4b619548 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:09.553211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1fe96-0321-43e6-a8e7-d2ed4b619548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:09.553570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1fe96-0321-43e6-a8e7-d2ed4b619548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:09.555230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1fe96-0321-43e6-a8e7-d2ed4b619548 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:09.571133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 914/1806] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:09.572411 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d1799-35af-4179-9bdd-965303bbfac4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:09.586617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d1799-35af-4179-9bdd-965303bbfac4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:09.592244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4a562-8185-45ab-8295-2bae79c339a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:09.592860 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4a562-8185-45ab-8295-2bae79c339a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:09.593394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4a562-8185-45ab-8295-2bae79c339a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:09.593730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4a562-8185-45ab-8295-2bae79c339a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:09.595073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4a562-8185-45ab-8295-2bae79c339a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:09.597007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4a562-8185-45ab-8295-2bae79c339a1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:09.632281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 893/1807] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:09 2022] POST /identity/v3/projects => generated 407 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:09.633817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1fe96-0321-43e6-a8e7-d2ed4b619548 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:09.644953 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1fe96-0321-43e6-a8e7-d2ed4b619548 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:09.707717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754e9d7-59a8-4a8f-b8ab-1cd70ebfb17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:09.708333 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754e9d7-59a8-4a8f-b8ab-1cd70ebfb17a admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:09.708609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754e9d7-59a8-4a8f-b8ab-1cd70ebfb17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:09.708876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754e9d7-59a8-4a8f-b8ab-1cd70ebfb17a admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:09.709524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754e9d7-59a8-4a8f-b8ab-1cd70ebfb17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:09.711651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754e9d7-59a8-4a8f-b8ab-1cd70ebfb17a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:09.735666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 915/1808] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:09 2022] POST /identity/v3/users => generated 304 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:09.740336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4a562-8185-45ab-8295-2bae79c339a1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:09.759925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4a562-8185-45ab-8295-2bae79c339a1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:09.765024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6506f-c9e0-4a5f-9da4-c7b36dac5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:09.765660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6506f-c9e0-4a5f-9da4-c7b36dac5cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:09.765931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6506f-c9e0-4a5f-9da4-c7b36dac5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:09.766208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6506f-c9e0-4a5f-9da4-c7b36dac5cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:09.766914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6506f-c9e0-4a5f-9da4-c7b36dac5cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:09.768592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6506f-c9e0-4a5f-9da4-c7b36dac5cd5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:09.779388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 894/1809] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:09.783437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754e9d7-59a8-4a8f-b8ab-1cd70ebfb17a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:09.793398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754e9d7-59a8-4a8f-b8ab-1cd70ebfb17a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:09.797897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f1a59-7db8-4b77-9171-c85a77a70fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:09.798508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f1a59-7db8-4b77-9171-c85a77a70fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:09.798779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f1a59-7db8-4b77-9171-c85a77a70fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:09.799172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f1a59-7db8-4b77-9171-c85a77a70fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:09.799952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f1a59-7db8-4b77-9171-c85a77a70fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:09.801555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f1a59-7db8-4b77-9171-c85a77a70fe5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:09.814619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 916/1810] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:09.819025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6506f-c9e0-4a5f-9da4-c7b36dac5cd5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:09.830044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6506f-c9e0-4a5f-9da4-c7b36dac5cd5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:09.835743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95524f0-179b-49ea-9234-1bfad69e46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:09.836483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95524f0-179b-49ea-9234-1bfad69e46f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:09.836826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95524f0-179b-49ea-9234-1bfad69e46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:09.837183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95524f0-179b-49ea-9234-1bfad69e46f7 admin admin] PATH_INFO: `/v3/projects/ec49c1642f664396adda9a5a8f4e2a75/users/2c4340f415e54415ad8bbe3d28137395/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:09.854072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95524f0-179b-49ea-9234-1bfad69e46f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec49c1642f664396adda9a5a8f4e2a75, user_id=2c4340f415e54415ad8bbe3d28137395, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:09.857275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95524f0-179b-49ea-9234-1bfad69e46f7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:09.874364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 895/1811] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:09 2022] PUT /identity/v3/projects/ec49c1642f664396adda9a5a8f4e2a75/users/2c4340f415e54415ad8bbe3d28137395/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:09.884796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfadbc6-84ff-4f91-99b4-ea68631c034e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:09.885075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfadbc6-84ff-4f91-99b4-ea68631c034e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:09.885346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfadbc6-84ff-4f91-99b4-ea68631c034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:09.914930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cbfadbc6-84ff-4f91-99b4-ea68631c034e None None] MFA Rules not processed for user `2c4340f415e54415ad8bbe3d28137395`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:09.916173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cbfadbc6-84ff-4f91-99b4-ea68631c034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:09.989078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 917/1812] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:09 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:09.993486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95524f0-179b-49ea-9234-1bfad69e46f7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:10.067235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95524f0-179b-49ea-9234-1bfad69e46f7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:10.068936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb64f5-ad23-4b2e-a728-5f6ac2cd311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:10.069684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb64f5-ad23-4b2e-a728-5f6ac2cd311a admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.070002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb64f5-ad23-4b2e-a728-5f6ac2cd311a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.070329 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb64f5-ad23-4b2e-a728-5f6ac2cd311a admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.071022 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb64f5-ad23-4b2e-a728-5f6ac2cd311a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:10.073152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb64f5-ad23-4b2e-a728-5f6ac2cd311a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:10.105068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 896/1813] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:09 2022] POST /identity/v3/projects => generated 407 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:10.106236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfadbc6-84ff-4f91-99b4-ea68631c034e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:10.117725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfadbc6-84ff-4f91-99b4-ea68631c034e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:10.122421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:10.193088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cef79b-4198-4b0b-997b-76d7db532e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:10.193786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cef79b-4198-4b0b-997b-76d7db532e90 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.194062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cef79b-4198-4b0b-997b-76d7db532e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.194335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cef79b-4198-4b0b-997b-76d7db532e90 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.195038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cef79b-4198-4b0b-997b-76d7db532e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:10.197066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cef79b-4198-4b0b-997b-76d7db532e90 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:10.222655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 918/1814] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:10 2022] POST /identity/v3/users => generated 310 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:10.226385 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb64f5-ad23-4b2e-a728-5f6ac2cd311a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:10.238624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb64f5-ad23-4b2e-a728-5f6ac2cd311a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:10.248164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cef79b-4198-4b0b-997b-76d7db532e90 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:10.249894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-99cef79b-4198-4b0b-997b-76d7db532e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:10.251676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e52492-181e-43c9-9db9-83605e7c2540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:10.252332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e52492-181e-43c9-9db9-83605e7c2540 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.252842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e52492-181e-43c9-9db9-83605e7c2540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.253137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e52492-181e-43c9-9db9-83605e7c2540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.253895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e52492-181e-43c9-9db9-83605e7c2540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:10.255651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e52492-181e-43c9-9db9-83605e7c2540 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:10.262704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cef79b-4198-4b0b-997b-76d7db532e90 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:10.267626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:10.268046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 897/1815] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:10.268266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.268537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.268802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] PATH_INFO: `/v3/users/cf8ad4f39e6443ba83ced976b30d4b67` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.269926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8ad4f39e6443ba83ced976b30d4b67)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:10.271915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:10.272207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e52492-181e-43c9-9db9-83605e7c2540 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:10.283160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e52492-181e-43c9-9db9-83605e7c2540 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:10.287872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9886a77-808c-4f28-bdb6-856405b59f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:10.288534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9886a77-808c-4f28-bdb6-856405b59f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.288811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9886a77-808c-4f28-bdb6-856405b59f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.289081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9886a77-808c-4f28-bdb6-856405b59f17 admin admin] PATH_INFO: `/v3/projects/0377bf98ed92481b89cf5b895b421024/users/25d4510027ed469e91ea67ffeb5d8fa5/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.302592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:10.306363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9886a77-808c-4f28-bdb6-856405b59f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0377bf98ed92481b89cf5b895b421024, user_id=25d4510027ed469e91ea67ffeb5d8fa5, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:10.309650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9886a77-808c-4f28-bdb6-856405b59f17 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:10.333361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8ad4f39e6443ba83ced976b30d4b67'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:10.336878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 898/1816] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:10 2022] PUT /identity/v3/projects/0377bf98ed92481b89cf5b895b421024/users/25d4510027ed469e91ea67ffeb5d8fa5/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:10.337937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9886a77-808c-4f28-bdb6-856405b59f17 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:10.342372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8ad4f39e6443ba83ced976b30d4b67'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:10.356304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8ad4f39e6443ba83ced976b30d4b67'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:10.356941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8ad4f39e6443ba83ced976b30d4b67'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:10.368428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f7aeefe-e769-432b-acbf-b41257b8b8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8ad4f39e6443ba83ced976b30d4b67'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:10.377364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 919/1817] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:10 2022] DELETE /identity/v3/users/cf8ad4f39e6443ba83ced976b30d4b67 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:10.381984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96575cba-f3e9-4c1c-b70a-c0f3ec126e63 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.382487 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96575cba-f3e9-4c1c-b70a-c0f3ec126e63 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.383062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96575cba-f3e9-4c1c-b70a-c0f3ec126e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.405432 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-96575cba-f3e9-4c1c-b70a-c0f3ec126e63 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:10.406629 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-96575cba-f3e9-4c1c-b70a-c0f3ec126e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:10.432509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9886a77-808c-4f28-bdb6-856405b59f17 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:10.492832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 920/1818] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:10.503699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96575cba-f3e9-4c1c-b70a-c0f3ec126e63 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:10.505116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-96575cba-f3e9-4c1c-b70a-c0f3ec126e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:10.506192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7673d7-deca-4cf5-8691-04fedfc55e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:10.506832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7673d7-deca-4cf5-8691-04fedfc55e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.507105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7673d7-deca-4cf5-8691-04fedfc55e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.507395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7673d7-deca-4cf5-8691-04fedfc55e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.508205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7673d7-deca-4cf5-8691-04fedfc55e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:10.509785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7673d7-deca-4cf5-8691-04fedfc55e97 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:10.520442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:10.526951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 899/1819] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:10.531377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7673d7-deca-4cf5-8691-04fedfc55e97 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:10.533692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fd7673d7-deca-4cf5-8691-04fedfc55e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:10.547438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7673d7-deca-4cf5-8691-04fedfc55e97 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:10.552727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2e08b-f318-4fbf-acd9-4d289b09c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:10.553457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e08b-f318-4fbf-acd9-4d289b09c13e admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.553739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e08b-f318-4fbf-acd9-4d289b09c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.554010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e08b-f318-4fbf-acd9-4d289b09c13e admin admin] PATH_INFO: `/v3/projects/0377bf98ed92481b89cf5b895b421024/users/25d4510027ed469e91ea67ffeb5d8fa5/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.555930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2e08b-f318-4fbf-acd9-4d289b09c13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0377bf98ed92481b89cf5b895b421024, user_id=25d4510027ed469e91ea67ffeb5d8fa5, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:10.558969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2e08b-f318-4fbf-acd9-4d289b09c13e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:10.571814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 900/1820] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:10 2022] PUT /identity/v3/projects/0377bf98ed92481b89cf5b895b421024/users/25d4510027ed469e91ea67ffeb5d8fa5/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:10.574234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96575cba-f3e9-4c1c-b70a-c0f3ec126e63 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:10.582426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5657c-448e-4554-a27e-743e9f521288 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.582713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5657c-448e-4554-a27e-743e9f521288 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.583023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5657c-448e-4554-a27e-743e9f521288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.616939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5fd5657c-448e-4554-a27e-743e9f521288 None None] MFA Rules not processed for user `25d4510027ed469e91ea67ffeb5d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:10.618143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5fd5657c-448e-4554-a27e-743e9f521288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:10.639389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5462dc-1092-441c-8636-67809f613ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:10.640145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5462dc-1092-441c-8636-67809f613ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.640624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5462dc-1092-441c-8636-67809f613ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.640962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5462dc-1092-441c-8636-67809f613ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.706334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 901/1821] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:10 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:10.717880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5657c-448e-4554-a27e-743e9f521288 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:10.720117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5fd5657c-448e-4554-a27e-743e9f521288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:10.732262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:10.781381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5462dc-1092-441c-8636-67809f613ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:10.786535 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5462dc-1092-441c-8636-67809f613ec1 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:10.797312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 921/1822] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:33:10.803256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5657c-448e-4554-a27e-743e9f521288 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:10.807661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124e411-8d67-4774-b7e5-ad238e7df68c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:10.808291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124e411-8d67-4774-b7e5-ad238e7df68c service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:10.808661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124e411-8d67-4774-b7e5-ad238e7df68c service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:10.808944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124e411-8d67-4774-b7e5-ad238e7df68c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:10.821902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124e411-8d67-4774-b7e5-ad238e7df68c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:10.821902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124e411-8d67-4774-b7e5-ad238e7df68c service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:10.831622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 902/1823] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:10 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:33:11.100303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5462dc-1092-441c-8636-67809f613ec1 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:11.103641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2e5462dc-1092-441c-8636-67809f613ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:11.124833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5462dc-1092-441c-8636-67809f613ec1 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:11.130537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bbff-7c43-417b-b964-ce104c206de4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:11.131542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bbff-7c43-417b-b964-ce104c206de4 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:11.131962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bbff-7c43-417b-b964-ce104c206de4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:11.132643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bbff-7c43-417b-b964-ce104c206de4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:11.135041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b903bbff-7c43-417b-b964-ce104c206de4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:11.215261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903bbff-7c43-417b-b964-ce104c206de4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:11.217186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903bbff-7c43-417b-b964-ce104c206de4 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:11.228579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 922/1824] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:11 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:11.380693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124e411-8d67-4774-b7e5-ad238e7df68c service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:11.382249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4124e411-8d67-4774-b7e5-ad238e7df68c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:11.399032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124e411-8d67-4774-b7e5-ad238e7df68c service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:11.404972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:11.406176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:11.407478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:11.407762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] PATH_INFO: `/v3/projects/00366a8343ae4cb28a63617d673e960f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:11.416514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] RBAC: Authorizing `identity:delete_project(project_id=00366a8343ae4cb28a63617d673e960f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:11.419493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:11.474741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00366a8343ae4cb28a63617d673e960f', 'request_id': 'req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:11.484346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00366a8343ae4cb28a63617d673e960f', 'request_id': 'req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:11.490839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00366a8343ae4cb28a63617d673e960f', 'request_id': 'req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:11.503494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] The token cache is being invalidate because project 00366a8343ae4cb28a63617d673e960f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:11.503906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:11.504560 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:11.511650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bbff-7c43-417b-b964-ce104c206de4 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:11.515399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 903/1825] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:11 2022] DELETE /identity/v3/projects/00366a8343ae4cb28a63617d673e960f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:11.553719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bbff-7c43-417b-b964-ce104c206de4 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:11.570996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:11.623690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:11.624324 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:11.625279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:11.625279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] PATH_INFO: `/v3/users/29bc2c5fefac4a7899693f8c5c4f3ac6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:11.626472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bc2c5fefac4a7899693f8c5c4f3ac6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:11.628578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:11.675965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bc2c5fefac4a7899693f8c5c4f3ac6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:11.684118 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bc2c5fefac4a7899693f8c5c4f3ac6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:11.697073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bc2c5fefac4a7899693f8c5c4f3ac6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:11.697791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bc2c5fefac4a7899693f8c5c4f3ac6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:11.705111 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b9d5e5da-b081-4f42-901f-468bafbbb8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bc2c5fefac4a7899693f8c5c4f3ac6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:11.711272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 923/1826] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:11 2022] DELETE /identity/v3/users/29bc2c5fefac4a7899693f8c5c4f3ac6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:12.005086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:12.005086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:12.020494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbd2d5-67aa-43cb-80a7-b06f168d64da admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:12.093630 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:12.094284 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.094607 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.094878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] PATH_INFO: `/v3/projects/6174778d5fba460294d7d77cc73e4d0f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.096591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6174778d5fba460294d7d77cc73e4d0f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:12.100390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:12.172471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:12.185395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6174778d5fba460294d7d77cc73e4d0f', 'request_id': 'req-a0db3623-a31f-4c3c-877c-5d32e4e39326'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:12.197712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6174778d5fba460294d7d77cc73e4d0f', 'request_id': 'req-a0db3623-a31f-4c3c-877c-5d32e4e39326'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:12.206558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6174778d5fba460294d7d77cc73e4d0f', 'request_id': 'req-a0db3623-a31f-4c3c-877c-5d32e4e39326'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:12.221204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] The token cache is being invalidate because project 6174778d5fba460294d7d77cc73e4d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:12.221740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:12.222481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a0db3623-a31f-4c3c-877c-5d32e4e39326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:12.224219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 904/1827] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:11 2022] DELETE /identity/v3/projects/6174778d5fba460294d7d77cc73e4d0f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:12.229162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b297b-680b-41a7-b703-bf047ae2a51b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.229728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b297b-680b-41a7-b703-bf047ae2a51b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.230091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b297b-680b-41a7-b703-bf047ae2a51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.256539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6c8b297b-680b-41a7-b703-bf047ae2a51b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:12.260130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6c8b297b-680b-41a7-b703-bf047ae2a51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:12.333680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 924/1828] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:12.342287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41f858-e689-44f1-9afb-2b2175236089 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.342574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41f858-e689-44f1-9afb-2b2175236089 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.342849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41f858-e689-44f1-9afb-2b2175236089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.365237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1b41f858-e689-44f1-9afb-2b2175236089 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:12.366647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1b41f858-e689-44f1-9afb-2b2175236089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:12.379674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 905/1829] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:12.383865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b297b-680b-41a7-b703-bf047ae2a51b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:12.395821 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b297b-680b-41a7-b703-bf047ae2a51b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:12.401651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df93a09-1048-4d83-ba7d-e2524d5eb6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:12.402309 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93a09-1048-4d83-ba7d-e2524d5eb6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.402760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93a09-1048-4d83-ba7d-e2524d5eb6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.402875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93a09-1048-4d83-ba7d-e2524d5eb6f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.403706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df93a09-1048-4d83-ba7d-e2524d5eb6f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:12.404151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df93a09-1048-4d83-ba7d-e2524d5eb6f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:12.405758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df93a09-1048-4d83-ba7d-e2524d5eb6f6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:12.420689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 925/1830] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:12.425475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41f858-e689-44f1-9afb-2b2175236089 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:12.435495 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41f858-e689-44f1-9afb-2b2175236089 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:12.440320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab24c0-04da-41ab-860e-20bcb00fd22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:12.441157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab24c0-04da-41ab-860e-20bcb00fd22e admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.441442 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab24c0-04da-41ab-860e-20bcb00fd22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.441762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab24c0-04da-41ab-860e-20bcb00fd22e admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.442403 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab24c0-04da-41ab-860e-20bcb00fd22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:12.444435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab24c0-04da-41ab-860e-20bcb00fd22e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:12.475875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 906/1831] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:12 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:12.480294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df93a09-1048-4d83-ba7d-e2524d5eb6f6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:12.491871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df93a09-1048-4d83-ba7d-e2524d5eb6f6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:12.513736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:12.562220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce898f-fe9b-49f2-af71-4ddf2e0aca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:12.562992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce898f-fe9b-49f2-af71-4ddf2e0aca1b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.563365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce898f-fe9b-49f2-af71-4ddf2e0aca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.563704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce898f-fe9b-49f2-af71-4ddf2e0aca1b admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.564573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce898f-fe9b-49f2-af71-4ddf2e0aca1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:12.567113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce898f-fe9b-49f2-af71-4ddf2e0aca1b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:12.588869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 926/1832] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:12 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:12.597044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab24c0-04da-41ab-860e-20bcb00fd22e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:12.612518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab24c0-04da-41ab-860e-20bcb00fd22e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:12.618866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bb1b8-d67b-499d-89a5-98f113e5caab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:12.619542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bb1b8-d67b-499d-89a5-98f113e5caab admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.619916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bb1b8-d67b-499d-89a5-98f113e5caab admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.620262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bb1b8-d67b-499d-89a5-98f113e5caab admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.621189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bb1b8-d67b-499d-89a5-98f113e5caab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:12.624216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bb1b8-d67b-499d-89a5-98f113e5caab admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:12.639891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 907/1833] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:12.643659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce898f-fe9b-49f2-af71-4ddf2e0aca1b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:12.667659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce898f-fe9b-49f2-af71-4ddf2e0aca1b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:12.667659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f5c11-bd11-4de9-839d-71c7e8253e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:12.667659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f5c11-bd11-4de9-839d-71c7e8253e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.667659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f5c11-bd11-4de9-839d-71c7e8253e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.668021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f5c11-bd11-4de9-839d-71c7e8253e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.668021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f5c11-bd11-4de9-839d-71c7e8253e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:12.668021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f5c11-bd11-4de9-839d-71c7e8253e30 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:12.678309 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 927/1834] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:12.682549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bb1b8-d67b-499d-89a5-98f113e5caab admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:12.694477 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bb1b8-d67b-499d-89a5-98f113e5caab admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:12.699918 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76b010-74d7-4169-855b-2c36f77662e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:12.700686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76b010-74d7-4169-855b-2c36f77662e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.700845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76b010-74d7-4169-855b-2c36f77662e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.701408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76b010-74d7-4169-855b-2c36f77662e6 admin admin] PATH_INFO: `/v3/projects/1ac85f27182c480fb932f3efddbee7b4/users/1c7e296b9725480f9ffe37963f545142/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.725309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76b010-74d7-4169-855b-2c36f77662e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac85f27182c480fb932f3efddbee7b4, user_id=1c7e296b9725480f9ffe37963f545142, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:12.729134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76b010-74d7-4169-855b-2c36f77662e6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:12.748626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 908/1835] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:12 2022] PUT /identity/v3/projects/1ac85f27182c480fb932f3efddbee7b4/users/1c7e296b9725480f9ffe37963f545142/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:12.759865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437746-d64b-4e72-8487-dfdec9a428ae None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.760235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437746-d64b-4e72-8487-dfdec9a428ae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.760575 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437746-d64b-4e72-8487-dfdec9a428ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.790677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aa437746-d64b-4e72-8487-dfdec9a428ae None None] MFA Rules not processed for user `1c7e296b9725480f9ffe37963f545142`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:12.792336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aa437746-d64b-4e72-8487-dfdec9a428ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:12.880884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 928/1836] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:12.885661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76b010-74d7-4169-855b-2c36f77662e6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:12.948727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76b010-74d7-4169-855b-2c36f77662e6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:12.954142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8ff7a-b181-4d06-affc-a360c02ebfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:12.954924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8ff7a-b181-4d06-affc-a360c02ebfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:12.955229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8ff7a-b181-4d06-affc-a360c02ebfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:12.955534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8ff7a-b181-4d06-affc-a360c02ebfe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:12.956476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8ff7a-b181-4d06-affc-a360c02ebfe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:12.958650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8ff7a-b181-4d06-affc-a360c02ebfe9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:12.998364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 909/1837] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:12 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:12.999020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437746-d64b-4e72-8487-dfdec9a428ae None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:13.009829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437746-d64b-4e72-8487-dfdec9a428ae None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:13.086550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dcdc5-03f2-4521-bbe2-52a741e10638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:13.087266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dcdc5-03f2-4521-bbe2-52a741e10638 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:13.087646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dcdc5-03f2-4521-bbe2-52a741e10638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:13.087978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dcdc5-03f2-4521-bbe2-52a741e10638 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:13.088863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dcdc5-03f2-4521-bbe2-52a741e10638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:13.090727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dcdc5-03f2-4521-bbe2-52a741e10638 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:13.115640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 929/1838] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:12 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:13.119490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8ff7a-b181-4d06-affc-a360c02ebfe9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:13.132621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8ff7a-b181-4d06-affc-a360c02ebfe9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:13.139634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040098-1e71-4d5b-8357-150bc617e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:13.141194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040098-1e71-4d5b-8357-150bc617e793 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:13.141694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040098-1e71-4d5b-8357-150bc617e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:13.142160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040098-1e71-4d5b-8357-150bc617e793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:13.143050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6040098-1e71-4d5b-8357-150bc617e793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:13.144960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6040098-1e71-4d5b-8357-150bc617e793 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:13.159789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 910/1839] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:13.164307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dcdc5-03f2-4521-bbe2-52a741e10638 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:13.175099 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dcdc5-03f2-4521-bbe2-52a741e10638 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:13.179918 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6b4d-8eb0-495c-aeb2-f6085bb7b69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:13.180686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6b4d-8eb0-495c-aeb2-f6085bb7b69f admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:13.181037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6b4d-8eb0-495c-aeb2-f6085bb7b69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:13.181378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6b4d-8eb0-495c-aeb2-f6085bb7b69f admin admin] PATH_INFO: `/v3/projects/34160e1768b14f6da223fad369a6e3c4/users/6c8e0802913146a68b403826f8254cbe/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:13.198458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6b4d-8eb0-495c-aeb2-f6085bb7b69f admin admin] RBAC: Authorizing `identity:create_grant(project_id=34160e1768b14f6da223fad369a6e3c4, user_id=6c8e0802913146a68b403826f8254cbe, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:13.201143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6b4d-8eb0-495c-aeb2-f6085bb7b69f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:13.205476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:13.219760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 930/1840] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:13 2022] PUT /identity/v3/projects/34160e1768b14f6da223fad369a6e3c4/users/6c8e0802913146a68b403826f8254cbe/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:13.224018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040098-1e71-4d5b-8357-150bc617e793 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:13.240838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040098-1e71-4d5b-8357-150bc617e793 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:13.319616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:13.430847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b03b2e-7e6d-4cf7-a42c-3e27ce6d62a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:13.431528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03b2e-7e6d-4cf7-a42c-3e27ce6d62a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:13.431806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03b2e-7e6d-4cf7-a42c-3e27ce6d62a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:13.432740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03b2e-7e6d-4cf7-a42c-3e27ce6d62a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:13.433162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b03b2e-7e6d-4cf7-a42c-3e27ce6d62a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:13.435216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b03b2e-7e6d-4cf7-a42c-3e27ce6d62a0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:13.462250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 911/1841] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:13.466384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6b4d-8eb0-495c-aeb2-f6085bb7b69f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:13.477981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6b4d-8eb0-495c-aeb2-f6085bb7b69f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:13.493360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5dfb8-fad1-4bd0-a2fe-1ced3b9d56ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:13.494054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5dfb8-fad1-4bd0-a2fe-1ced3b9d56ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:13.494332 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5dfb8-fad1-4bd0-a2fe-1ced3b9d56ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:13.494580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5dfb8-fad1-4bd0-a2fe-1ced3b9d56ca admin admin] PATH_INFO: `/v3/projects/34160e1768b14f6da223fad369a6e3c4/users/6c8e0802913146a68b403826f8254cbe/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:13.499043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5dfb8-fad1-4bd0-a2fe-1ced3b9d56ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=34160e1768b14f6da223fad369a6e3c4, user_id=6c8e0802913146a68b403826f8254cbe, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:13.501707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5dfb8-fad1-4bd0-a2fe-1ced3b9d56ca admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:13.560087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fdeb-0a7a-47d7-9044-a7b08758be10 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:13.560978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fdeb-0a7a-47d7-9044-a7b08758be10 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:13.561394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fdeb-0a7a-47d7-9044-a7b08758be10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:13.561958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 931/1842] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:13 2022] PUT /identity/v3/projects/34160e1768b14f6da223fad369a6e3c4/users/6c8e0802913146a68b403826f8254cbe/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:13.619519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2a29fdeb-0a7a-47d7-9044-a7b08758be10 None None] MFA Rules not processed for user `6c8e0802913146a68b403826f8254cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:13.620813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2a29fdeb-0a7a-47d7-9044-a7b08758be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:13.789145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 912/1843] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:13.831299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5dfb8-fad1-4bd0-a2fe-1ced3b9d56ca admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:13.833927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-60f5dfb8-fad1-4bd0-a2fe-1ced3b9d56ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:13.910175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5dfb8-fad1-4bd0-a2fe-1ced3b9d56ca admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:13.915328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da28aa-a81c-4c64-921d-913f05f4ccc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:13.916819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da28aa-a81c-4c64-921d-913f05f4ccc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:13.917300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da28aa-a81c-4c64-921d-913f05f4ccc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:13.917891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da28aa-a81c-4c64-921d-913f05f4ccc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:13.930138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da28aa-a81c-4c64-921d-913f05f4ccc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:13.932393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da28aa-a81c-4c64-921d-913f05f4ccc6 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:13.956935 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 932/1844] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:14.002600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29fdeb-0a7a-47d7-9044-a7b08758be10 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:14.004131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2a29fdeb-0a7a-47d7-9044-a7b08758be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:14.119386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da28aa-a81c-4c64-921d-913f05f4ccc6 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:14.129201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da28aa-a81c-4c64-921d-913f05f4ccc6 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:14.133559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d65c09-1ff0-442d-ae5f-64eb7bdf3cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:14.134343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d65c09-1ff0-442d-ae5f-64eb7bdf3cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:14.134621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d65c09-1ff0-442d-ae5f-64eb7bdf3cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:14.134888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d65c09-1ff0-442d-ae5f-64eb7bdf3cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:14.185742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29fdeb-0a7a-47d7-9044-a7b08758be10 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:14.201060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:14.203092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:14.203438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:14.203855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] PATH_INFO: `/v3/users/389545d6dded4c37982ef607319dd835` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:14.210192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=389545d6dded4c37982ef607319dd835)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:14.215744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:14.256840 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d65c09-1ff0-442d-ae5f-64eb7bdf3cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:14.258367 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d65c09-1ff0-442d-ae5f-64eb7bdf3cc4 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:14.276488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 933/1845] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:33:14.331617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389545d6dded4c37982ef607319dd835'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:14.331617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389545d6dded4c37982ef607319dd835'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:14.347180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389545d6dded4c37982ef607319dd835'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:14.350152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:14.371786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389545d6dded4c37982ef607319dd835'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:14.385331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389545d6dded4c37982ef607319dd835'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:14.402391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 913/1846] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:14 2022] DELETE /identity/v3/users/389545d6dded4c37982ef607319dd835 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:14.404668 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401fed7-c7ee-48a9-9fd8-6a9396169c0f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:14.405322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401fed7-c7ee-48a9-9fd8-6a9396169c0f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:14.405699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401fed7-c7ee-48a9-9fd8-6a9396169c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:14.451636 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5401fed7-c7ee-48a9-9fd8-6a9396169c0f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:14.454166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5401fed7-c7ee-48a9-9fd8-6a9396169c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:14.632588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 934/1847] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:14.651253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:14.654346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:14.813964 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ebea3-d6d0-432d-b42a-e4b338aaec43 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:14.831568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640e582-0ec4-47f2-ada7-20d9ec55f274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:14.832604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640e582-0ec4-47f2-ada7-20d9ec55f274 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:14.833266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640e582-0ec4-47f2-ada7-20d9ec55f274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:14.833760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640e582-0ec4-47f2-ada7-20d9ec55f274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:14.864982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640e582-0ec4-47f2-ada7-20d9ec55f274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:14.866488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640e582-0ec4-47f2-ada7-20d9ec55f274 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:14.901389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 914/1848] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:15.939236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401fed7-c7ee-48a9-9fd8-6a9396169c0f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:15.942353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5401fed7-c7ee-48a9-9fd8-6a9396169c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:15.972683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401fed7-c7ee-48a9-9fd8-6a9396169c0f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:15.992609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:15.993927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:15.994347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:15.994755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] PATH_INFO: `/v3/projects/dbaf9e258e8a4eaebd589fbc467755b3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:15.996703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbaf9e258e8a4eaebd589fbc467755b3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:16.001440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:16.011990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9ffa8-f8d7-4c86-a85d-97bf7e2ee3ea None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:16.012622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9ffa8-f8d7-4c86-a85d-97bf7e2ee3ea None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:16.012622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9ffa8-f8d7-4c86-a85d-97bf7e2ee3ea None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:16.014291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 915/1849] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:33:16.049547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbf5d2-f6f7-432e-93ef-da57d5090f15 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:16.050400 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbf5d2-f6f7-432e-93ef-da57d5090f15 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:16.051123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbf5d2-f6f7-432e-93ef-da57d5090f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:16.072664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:16.096843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-76fbf5d2-f6f7-432e-93ef-da57d5090f15 None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:16.100053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-76fbf5d2-f6f7-432e-93ef-da57d5090f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:16.158074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbaf9e258e8a4eaebd589fbc467755b3', 'request_id': 'req-ccccf148-92f8-4222-a897-c18989ada7a2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:16.185000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbaf9e258e8a4eaebd589fbc467755b3', 'request_id': 'req-ccccf148-92f8-4222-a897-c18989ada7a2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:16.195126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbaf9e258e8a4eaebd589fbc467755b3', 'request_id': 'req-ccccf148-92f8-4222-a897-c18989ada7a2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:16.224043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] The token cache is being invalidate because project dbaf9e258e8a4eaebd589fbc467755b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:16.224722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:16.227855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:16.234630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 935/1850] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:15 2022] DELETE /identity/v3/projects/dbaf9e258e8a4eaebd589fbc467755b3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:16.239094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:16.247241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:16.270647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 916/1851] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:33:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:16.290177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbf5d2-f6f7-432e-93ef-da57d5090f15 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:16.292485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-76fbf5d2-f6f7-432e-93ef-da57d5090f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:16.317229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbf5d2-f6f7-432e-93ef-da57d5090f15 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:16.414405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccf148-92f8-4222-a897-c18989ada7a2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:16.420211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:16.420971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:16.421333 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:16.421697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] PATH_INFO: `/v3/users/932cfa53ce3640e48e103511967e1fe4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:16.422977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932cfa53ce3640e48e103511967e1fe4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:16.425385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:16.484365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211630ef-35e4-4d5c-868b-6af15c738680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:16.485428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211630ef-35e4-4d5c-868b-6af15c738680 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:16.485799 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211630ef-35e4-4d5c-868b-6af15c738680 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:16.486215 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211630ef-35e4-4d5c-868b-6af15c738680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:16.496730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:16.502299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211630ef-35e4-4d5c-868b-6af15c738680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:16.505461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211630ef-35e4-4d5c-868b-6af15c738680 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:16.509486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932cfa53ce3640e48e103511967e1fe4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:16.521821 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932cfa53ce3640e48e103511967e1fe4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:16.533988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 917/1852] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:16.539028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932cfa53ce3640e48e103511967e1fe4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:16.540535 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932cfa53ce3640e48e103511967e1fe4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:16.550546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a15a11bb-051f-4384-b3a4-62bcd581c928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932cfa53ce3640e48e103511967e1fe4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:16.557390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 936/1853] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:16 2022] DELETE /identity/v3/users/932cfa53ce3640e48e103511967e1fe4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:16.952106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211630ef-35e4-4d5c-868b-6af15c738680 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:16.966182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211630ef-35e4-4d5c-868b-6af15c738680 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:17.036578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:17.037222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.037403 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.037672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] PATH_INFO: `/v3/projects/eaaa44675c4b4c418e61002223651f24` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.038876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaaa44675c4b4c418e61002223651f24)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:17.040990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:17.092825 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaaa44675c4b4c418e61002223651f24', 'request_id': 'req-05671186-e134-4bfc-a14d-9d7cd2edbe58'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.103855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaaa44675c4b4c418e61002223651f24', 'request_id': 'req-05671186-e134-4bfc-a14d-9d7cd2edbe58'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.114196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaaa44675c4b4c418e61002223651f24', 'request_id': 'req-05671186-e134-4bfc-a14d-9d7cd2edbe58'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.128417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] The token cache is being invalidate because project eaaa44675c4b4c418e61002223651f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:17.128780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.129505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-05671186-e134-4bfc-a14d-9d7cd2edbe58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.131398 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 918/1854] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:16 2022] DELETE /identity/v3/projects/eaaa44675c4b4c418e61002223651f24 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:17.136443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f287e-1fc0-44e1-ad93-76739cbf70c9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.136928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f287e-1fc0-44e1-ad93-76739cbf70c9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.137195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f287e-1fc0-44e1-ad93-76739cbf70c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.162817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fb1f287e-1fc0-44e1-ad93-76739cbf70c9 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:17.164232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fb1f287e-1fc0-44e1-ad93-76739cbf70c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:17.186597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:17.237497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 937/1855] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:17.246092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18185f-cff4-449b-be69-b1316814ac64 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.246376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18185f-cff4-449b-be69-b1316814ac64 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.246718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18185f-cff4-449b-be69-b1316814ac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.266398 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4e18185f-cff4-449b-be69-b1316814ac64 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:17.267712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4e18185f-cff4-449b-be69-b1316814ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:17.276248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 919/1856] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:17.282632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f287e-1fc0-44e1-ad93-76739cbf70c9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:17.293076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f287e-1fc0-44e1-ad93-76739cbf70c9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:17.298569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ee74-47e0-450b-a339-79fd16ca301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:17.299181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ee74-47e0-450b-a339-79fd16ca301f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.299493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ee74-47e0-450b-a339-79fd16ca301f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.299768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ee74-47e0-450b-a339-79fd16ca301f admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.300422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ee74-47e0-450b-a339-79fd16ca301f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:17.300726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ee74-47e0-450b-a339-79fd16ca301f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:17.302385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ee74-47e0-450b-a339-79fd16ca301f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:17.315581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 938/1857] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:17.320653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18185f-cff4-449b-be69-b1316814ac64 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:17.330073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18185f-cff4-449b-be69-b1316814ac64 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:17.334630 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0236494-22e1-4cc7-ab6c-61e916dc80c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:17.335231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236494-22e1-4cc7-ab6c-61e916dc80c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.335542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236494-22e1-4cc7-ab6c-61e916dc80c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.335810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236494-22e1-4cc7-ab6c-61e916dc80c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.336445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0236494-22e1-4cc7-ab6c-61e916dc80c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:17.338366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0236494-22e1-4cc7-ab6c-61e916dc80c6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:17.366838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 920/1858] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:17 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:17.371505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ee74-47e0-450b-a339-79fd16ca301f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:17.383495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ee74-47e0-450b-a339-79fd16ca301f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:17.462471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6ff99-8ca2-4647-b148-957d93afde7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:17.463186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6ff99-8ca2-4647-b148-957d93afde7f admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.463565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6ff99-8ca2-4647-b148-957d93afde7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.463846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6ff99-8ca2-4647-b148-957d93afde7f admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.464544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6ff99-8ca2-4647-b148-957d93afde7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:17.467673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6ff99-8ca2-4647-b148-957d93afde7f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:17.503879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 939/1859] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:17 2022] POST /identity/v3/users => generated 282 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:17.505664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0236494-22e1-4cc7-ab6c-61e916dc80c6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:17.519814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0236494-22e1-4cc7-ab6c-61e916dc80c6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:17.524815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf8abc-c7db-47ba-bfc3-8b175582b3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:17.525587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf8abc-c7db-47ba-bfc3-8b175582b3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.526112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf8abc-c7db-47ba-bfc3-8b175582b3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.526513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf8abc-c7db-47ba-bfc3-8b175582b3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.527428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf8abc-c7db-47ba-bfc3-8b175582b3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:17.529053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf8abc-c7db-47ba-bfc3-8b175582b3a1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:17.548069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 921/1860] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:17.552252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6ff99-8ca2-4647-b148-957d93afde7f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:17.594080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6ff99-8ca2-4647-b148-957d93afde7f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:17.606655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f31958-4f47-4d00-b8fe-fd8f753b60d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:17.609022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f31958-4f47-4d00-b8fe-fd8f753b60d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.609022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f31958-4f47-4d00-b8fe-fd8f753b60d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.609022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f31958-4f47-4d00-b8fe-fd8f753b60d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.609481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f31958-4f47-4d00-b8fe-fd8f753b60d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:17.615494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f31958-4f47-4d00-b8fe-fd8f753b60d2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:17.627822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf8abc-c7db-47ba-bfc3-8b175582b3a1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:17.629736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f2bf8abc-c7db-47ba-bfc3-8b175582b3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:17.653355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 940/1861] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:17.657704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f31958-4f47-4d00-b8fe-fd8f753b60d2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:17.661515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf8abc-c7db-47ba-bfc3-8b175582b3a1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:17.681167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:17.682525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.682822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.683233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] PATH_INFO: `/v3/users/1c7e296b9725480f9ffe37963f545142` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.685061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7e296b9725480f9ffe37963f545142)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:17.685789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f31958-4f47-4d00-b8fe-fd8f753b60d2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:17.687430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:17.692928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427f7b1-49fa-4d94-b2b1-f7bf4578322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:17.693728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427f7b1-49fa-4d94-b2b1-f7bf4578322a admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.694098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427f7b1-49fa-4d94-b2b1-f7bf4578322a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.694460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427f7b1-49fa-4d94-b2b1-f7bf4578322a admin admin] PATH_INFO: `/v3/projects/f26ad9a1cc174b519a0c6eb0598be238/users/21b8fcac7f194553ba50aadbda74e31e/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.719450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427f7b1-49fa-4d94-b2b1-f7bf4578322a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26ad9a1cc174b519a0c6eb0598be238, user_id=21b8fcac7f194553ba50aadbda74e31e, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:17.724335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427f7b1-49fa-4d94-b2b1-f7bf4578322a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:17.755300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 941/1862] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:17 2022] PUT /identity/v3/projects/f26ad9a1cc174b519a0c6eb0598be238/users/21b8fcac7f194553ba50aadbda74e31e/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:17.756483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427f7b1-49fa-4d94-b2b1-f7bf4578322a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:17.764223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7427f7b1-49fa-4d94-b2b1-f7bf4578322a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:17.767673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:17.779101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7e296b9725480f9ffe37963f545142'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.780777 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7e296b9725480f9ffe37963f545142'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.795140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7e296b9725480f9ffe37963f545142'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.812950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7e296b9725480f9ffe37963f545142'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.824043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f0e400b-3651-499c-b326-e12b1bd12052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7e296b9725480f9ffe37963f545142'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.835404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 922/1863] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:17 2022] DELETE /identity/v3/users/1c7e296b9725480f9ffe37963f545142 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:17.837860 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923275be-a2aa-406f-aefe-1b673a96bc7f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.838192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923275be-a2aa-406f-aefe-1b673a96bc7f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.838493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923275be-a2aa-406f-aefe-1b673a96bc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.853554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427f7b1-49fa-4d94-b2b1-f7bf4578322a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:17.867509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:17.880650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-923275be-a2aa-406f-aefe-1b673a96bc7f None None] MFA Rules not processed for user `21b8fcac7f194553ba50aadbda74e31e`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:17.881881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-923275be-a2aa-406f-aefe-1b673a96bc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:17.921216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:17.921865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.922146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.922420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] PATH_INFO: `/v3/users/2c4340f415e54415ad8bbe3d28137395` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.923607 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4340f415e54415ad8bbe3d28137395)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:17.925532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:17.951665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 923/1864] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:17.955364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b400c-36da-42ff-b251-28cd27b92657 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:17.955364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b400c-36da-42ff-b251-28cd27b92657 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:17.955364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b400c-36da-42ff-b251-28cd27b92657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:17.973873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0e0b400c-36da-42ff-b251-28cd27b92657 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:17.975809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0e0b400c-36da-42ff-b251-28cd27b92657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:17.977677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4340f415e54415ad8bbe3d28137395'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:17.984653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 924/1865] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:17.985421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b400c-36da-42ff-b251-28cd27b92657 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:17.986759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0e0b400c-36da-42ff-b251-28cd27b92657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:17.989041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4340f415e54415ad8bbe3d28137395'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:18.001151 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b400c-36da-42ff-b251-28cd27b92657 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.002637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4340f415e54415ad8bbe3d28137395'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:18.003363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4340f415e54415ad8bbe3d28137395'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:18.008107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318c17f-d69d-4c19-a2be-5335a08a6059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.008803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c17f-d69d-4c19-a2be-5335a08a6059 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.009594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c17f-d69d-4c19-a2be-5335a08a6059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.009939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c17f-d69d-4c19-a2be-5335a08a6059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.010954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318c17f-d69d-4c19-a2be-5335a08a6059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.011368 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4340f415e54415ad8bbe3d28137395'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:18.013537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318c17f-d69d-4c19-a2be-5335a08a6059 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.022986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 942/1866] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:17 2022] DELETE /identity/v3/users/2c4340f415e54415ad8bbe3d28137395 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:18.022986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.022986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.054614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 925/1867] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:17 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:18.057006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58206fe1-cbde-48df-ac48-fe4da297eab8 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.057637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58206fe1-cbde-48df-ac48-fe4da297eab8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.057754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58206fe1-cbde-48df-ac48-fe4da297eab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.083079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-58206fe1-cbde-48df-ac48-fe4da297eab8 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:18.084634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-58206fe1-cbde-48df-ac48-fe4da297eab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.099738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2f5ef-e792-4938-ade2-23ac5488d907 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.155634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 926/1868] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:18.156679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58206fe1-cbde-48df-ac48-fe4da297eab8 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.158156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-58206fe1-cbde-48df-ac48-fe4da297eab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.171383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4bf68-30f8-4ea8-a194-856128868281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.171965 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58206fe1-cbde-48df-ac48-fe4da297eab8 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.172090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4bf68-30f8-4ea8-a194-856128868281 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.172277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4bf68-30f8-4ea8-a194-856128868281 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.172538 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4bf68-30f8-4ea8-a194-856128868281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.174959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-94c4bf68-30f8-4ea8-a194-856128868281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.176863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48131b53-702e-4b8c-83b6-9bd18b69bcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.177532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48131b53-702e-4b8c-83b6-9bd18b69bcbe admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.177880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48131b53-702e-4b8c-83b6-9bd18b69bcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.178148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48131b53-702e-4b8c-83b6-9bd18b69bcbe admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.178782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48131b53-702e-4b8c-83b6-9bd18b69bcbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.180730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48131b53-702e-4b8c-83b6-9bd18b69bcbe admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.185264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:18.189567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4bf68-30f8-4ea8-a194-856128868281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.191516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4bf68-30f8-4ea8-a194-856128868281 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.201455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:18.203909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 943/1869] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:18.204744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4bf68-30f8-4ea8-a194-856128868281 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.215770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4bf68-30f8-4ea8-a194-856128868281 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.220085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410a4f8-a514-4a2d-8dfb-ca3089320ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.220624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410a4f8-a514-4a2d-8dfb-ca3089320ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.221274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410a4f8-a514-4a2d-8dfb-ca3089320ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.221394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 927/1870] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:18 2022] POST /identity/v3/users => generated 288 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:18.224388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410a4f8-a514-4a2d-8dfb-ca3089320ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.225081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48131b53-702e-4b8c-83b6-9bd18b69bcbe admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.235104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410a4f8-a514-4a2d-8dfb-ca3089320ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.236667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410a4f8-a514-4a2d-8dfb-ca3089320ad9 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.249901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 944/1871] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:18.250839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48131b53-702e-4b8c-83b6-9bd18b69bcbe admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.268129 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c2a95-aeac-47cd-96d1-2a0a0f11d921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.268765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c2a95-aeac-47cd-96d1-2a0a0f11d921 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.269043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c2a95-aeac-47cd-96d1-2a0a0f11d921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.269312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c2a95-aeac-47cd-96d1-2a0a0f11d921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.269976 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c2a95-aeac-47cd-96d1-2a0a0f11d921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.271632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c2a95-aeac-47cd-96d1-2a0a0f11d921 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.286177 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410a4f8-a514-4a2d-8dfb-ca3089320ad9 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.287706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a410a4f8-a514-4a2d-8dfb-ca3089320ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.295997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 928/1872] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:18.298422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c2a95-aeac-47cd-96d1-2a0a0f11d921 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.309527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c2a95-aeac-47cd-96d1-2a0a0f11d921 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.317433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a8e06-88c7-482e-9c86-c290e868176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.318128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a8e06-88c7-482e-9c86-c290e868176f admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.318404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a8e06-88c7-482e-9c86-c290e868176f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.318670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a8e06-88c7-482e-9c86-c290e868176f admin admin] PATH_INFO: `/v3/projects/7741342ffaa54133a8a1a11b4690b203/users/ab2367dff422440d83df758706979e86/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.324159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410a4f8-a514-4a2d-8dfb-ca3089320ad9 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.330650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.331717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.332169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.335092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a8e06-88c7-482e-9c86-c290e868176f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7741342ffaa54133a8a1a11b4690b203, user_id=ab2367dff422440d83df758706979e86, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.335634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] PATH_INFO: `/v3/users/9fab7912d81c4d73a503b8cd7a69dcdd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.337226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fab7912d81c4d73a503b8cd7a69dcdd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.337963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a8e06-88c7-482e-9c86-c290e868176f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.339625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.357641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 929/1873] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:18 2022] PUT /identity/v3/projects/7741342ffaa54133a8a1a11b4690b203/users/ab2367dff422440d83df758706979e86/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:18.361623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a8e06-88c7-482e-9c86-c290e868176f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.411615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fab7912d81c4d73a503b8cd7a69dcdd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:18.424390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fab7912d81c4d73a503b8cd7a69dcdd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:18.443587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fab7912d81c4d73a503b8cd7a69dcdd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:18.444884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fab7912d81c4d73a503b8cd7a69dcdd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:18.446553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a8e06-88c7-482e-9c86-c290e868176f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.452761 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d372c2-189a-44f1-be20-c8f10a40ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.453700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d372c2-189a-44f1-be20-c8f10a40ed13 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.453960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d372c2-189a-44f1-be20-c8f10a40ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.454531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d372c2-189a-44f1-be20-c8f10a40ed13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.454804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e249d7e3-912b-4a3c-8808-cfc38cb4ec40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fab7912d81c4d73a503b8cd7a69dcdd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:18.455481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d372c2-189a-44f1-be20-c8f10a40ed13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.457189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d372c2-189a-44f1-be20-c8f10a40ed13 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.465770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 945/1874] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:18 2022] DELETE /identity/v3/users/9fab7912d81c4d73a503b8cd7a69dcdd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:18.466700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa96d8-6636-4a06-85c7-2487ee20e564 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.466983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa96d8-6636-4a06-85c7-2487ee20e564 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.467254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa96d8-6636-4a06-85c7-2487ee20e564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.471357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 930/1875] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:18.476353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d372c2-189a-44f1-be20-c8f10a40ed13 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.478818 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-09d372c2-189a-44f1-be20-c8f10a40ed13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.497307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d372c2-189a-44f1-be20-c8f10a40ed13 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.500800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7aaa96d8-6636-4a06-85c7-2487ee20e564 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:18.502073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7aaa96d8-6636-4a06-85c7-2487ee20e564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.574382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d041ad-dd5a-4af1-9e9f-ef7ade90c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.575469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d041ad-dd5a-4af1-9e9f-ef7ade90c569 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.575736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d041ad-dd5a-4af1-9e9f-ef7ade90c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.576007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d041ad-dd5a-4af1-9e9f-ef7ade90c569 admin admin] PATH_INFO: `/v3/projects/7741342ffaa54133a8a1a11b4690b203/users/ab2367dff422440d83df758706979e86/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.577523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 946/1876] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:18.578314 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d041ad-dd5a-4af1-9e9f-ef7ade90c569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7741342ffaa54133a8a1a11b4690b203, user_id=ab2367dff422440d83df758706979e86, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.583298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d041ad-dd5a-4af1-9e9f-ef7ade90c569 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.588273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa96d8-6636-4a06-85c7-2487ee20e564 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.590316 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7aaa96d8-6636-4a06-85c7-2487ee20e564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.596354 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 931/1877] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:18 2022] PUT /identity/v3/projects/7741342ffaa54133a8a1a11b4690b203/users/ab2367dff422440d83df758706979e86/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:18.613069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394d37b-a98c-4f29-b4d4-d32b11cc10f5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.613855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394d37b-a98c-4f29-b4d4-d32b11cc10f5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.614210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394d37b-a98c-4f29-b4d4-d32b11cc10f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.669367 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a394d37b-a98c-4f29-b4d4-d32b11cc10f5 None None] MFA Rules not processed for user `ab2367dff422440d83df758706979e86`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:18.670704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a394d37b-a98c-4f29-b4d4-d32b11cc10f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.672934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa96d8-6636-4a06-85c7-2487ee20e564 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.680540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:18.739640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:18.743243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22c4a5-9f41-496f-9327-f3eddf7e692c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.744184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c4a5-9f41-496f-9327-f3eddf7e692c service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.744696 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c4a5-9f41-496f-9327-f3eddf7e692c service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.745273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c4a5-9f41-496f-9327-f3eddf7e692c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.776979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 932/1878] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:18.789566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394d37b-a98c-4f29-b4d4-d32b11cc10f5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.791196 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a394d37b-a98c-4f29-b4d4-d32b11cc10f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.861805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394d37b-a98c-4f29-b4d4-d32b11cc10f5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.862831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22c4a5-9f41-496f-9327-f3eddf7e692c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.865587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22c4a5-9f41-496f-9327-f3eddf7e692c service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.866260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d4b82-500c-4a88-8ddd-e7a2a3f9876c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.867231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d4b82-500c-4a88-8ddd-e7a2a3f9876c service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.867846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d4b82-500c-4a88-8ddd-e7a2a3f9876c service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.867846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d4b82-500c-4a88-8ddd-e7a2a3f9876c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.881207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 947/1879] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:33:18.886952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d4b82-500c-4a88-8ddd-e7a2a3f9876c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.889260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d4b82-500c-4a88-8ddd-e7a2a3f9876c service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:18.903671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 933/1880] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:33:18.946325 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22c4a5-9f41-496f-9327-f3eddf7e692c service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:18.946325 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fc22c4a5-9f41-496f-9327-f3eddf7e692c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:18.981874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22c4a5-9f41-496f-9327-f3eddf7e692c service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:18.992449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:18.992449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:18.992449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:18.992449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] PATH_INFO: `/v3/projects/ec49c1642f664396adda9a5a8f4e2a75` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:18.992753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec49c1642f664396adda9a5a8f4e2a75)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:18.992753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:19.005535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d4b82-500c-4a88-8ddd-e7a2a3f9876c service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:19.016510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d4b82-500c-4a88-8ddd-e7a2a3f9876c service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:19.021368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0815b7-c3be-4a8d-8ed1-195e1c8a8bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:19.022041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0815b7-c3be-4a8d-8ed1-195e1c8a8bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:19.022350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0815b7-c3be-4a8d-8ed1-195e1c8a8bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:19.022624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0815b7-c3be-4a8d-8ed1-195e1c8a8bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:19.024551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3f0815b7-c3be-4a8d-8ed1-195e1c8a8bc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:19.063223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec49c1642f664396adda9a5a8f4e2a75', 'request_id': 'req-e69b530f-ba39-4954-8c72-fcd4e1a1e357'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.076613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec49c1642f664396adda9a5a8f4e2a75', 'request_id': 'req-e69b530f-ba39-4954-8c72-fcd4e1a1e357'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.084939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec49c1642f664396adda9a5a8f4e2a75', 'request_id': 'req-e69b530f-ba39-4954-8c72-fcd4e1a1e357'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.103643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0815b7-c3be-4a8d-8ed1-195e1c8a8bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:19.105037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] The token cache is being invalidate because project ec49c1642f664396adda9a5a8f4e2a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:19.105216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0815b7-c3be-4a8d-8ed1-195e1c8a8bc1 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:19.105339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.106000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.108312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 948/1881] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:18 2022] DELETE /identity/v3/projects/ec49c1642f664396adda9a5a8f4e2a75 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:19.111391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:19.113100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:19.116374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 934/1882] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:19.117324 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0815b7-c3be-4a8d-8ed1-195e1c8a8bc1 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:19.129277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0815b7-c3be-4a8d-8ed1-195e1c8a8bc1 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:19.184445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:19.214679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b530f-ba39-4954-8c72-fcd4e1a1e357 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:19.217755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:19.218409 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:19.218692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:19.218965 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] PATH_INFO: `/v3/users/25d4510027ed469e91ea67ffeb5d8fa5` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:19.220612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d4510027ed469e91ea67ffeb5d8fa5)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:19.220790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:19.221604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:19.221887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:19.222337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] PATH_INFO: `/v3/projects/1ac85f27182c480fb932f3efddbee7b4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:19.223552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:19.223962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac85f27182c480fb932f3efddbee7b4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:19.226177 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:19.249708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:19.290744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d4510027ed469e91ea67ffeb5d8fa5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.291696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d4510027ed469e91ea67ffeb5d8fa5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.305700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d4510027ed469e91ea67ffeb5d8fa5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.327765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d4510027ed469e91ea67ffeb5d8fa5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.336141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d4510027ed469e91ea67ffeb5d8fa5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.343219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 935/1883] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:19 2022] DELETE /identity/v3/users/25d4510027ed469e91ea67ffeb5d8fa5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:19.344112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:19.362364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac85f27182c480fb932f3efddbee7b4', 'request_id': 'req-6f479fc4-f922-4d6c-921f-0c287c747e5a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.363953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:19.377921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac85f27182c480fb932f3efddbee7b4', 'request_id': 'req-6f479fc4-f922-4d6c-921f-0c287c747e5a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.395101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac85f27182c480fb932f3efddbee7b4', 'request_id': 'req-6f479fc4-f922-4d6c-921f-0c287c747e5a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.411995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] The token cache is being invalidate because project 1ac85f27182c480fb932f3efddbee7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:19.412358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.412978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.414522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 949/1884] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:19 2022] DELETE /identity/v3/projects/1ac85f27182c480fb932f3efddbee7b4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:19.418717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:19.420104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:19.448159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccb802-8ad2-4fef-91d6-9b257d09367b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:19.454747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:19.455890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:19.456177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:19.456450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] PATH_INFO: `/v3/projects/ec2e5754856a46a5af1643bace79bb82` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:19.457810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2e5754856a46a5af1643bace79bb82)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:19.459995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:19.498920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f479fc4-f922-4d6c-921f-0c287c747e5a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:19.504786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:19.505442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:19.505865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:19.506155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] PATH_INFO: `/v3/users/6c8e0802913146a68b403826f8254cbe` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:19.507684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8e0802913146a68b403826f8254cbe)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:19.509682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:19.525598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2e5754856a46a5af1643bace79bb82', 'request_id': 'req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.538101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2e5754856a46a5af1643bace79bb82', 'request_id': 'req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.558124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2e5754856a46a5af1643bace79bb82', 'request_id': 'req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.575342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] The token cache is being invalidate because project ec2e5754856a46a5af1643bace79bb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:19.575744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.576528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.579116 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 936/1885] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:19 2022] DELETE /identity/v3/projects/ec2e5754856a46a5af1643bace79bb82 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:19.582452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8e0802913146a68b403826f8254cbe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.584483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:19.586255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:19.595644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8e0802913146a68b403826f8254cbe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.612179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8e0802913146a68b403826f8254cbe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.613806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8e0802913146a68b403826f8254cbe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.616466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:19.623946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8e0802913146a68b403826f8254cbe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.635229 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 950/1886] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:19 2022] DELETE /identity/v3/users/6c8e0802913146a68b403826f8254cbe => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:19.646329 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:19.701235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dc12d-8f6b-4f72-a43e-ffcb33dbfe6f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:19.809874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:19.811515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:19.812003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:19.812526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] PATH_INFO: `/v3/users/28cd9175b16e470ca4983babb454acd7` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:19.813934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28cd9175b16e470ca4983babb454acd7)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:19.817159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:19.921068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28cd9175b16e470ca4983babb454acd7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.921717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28cd9175b16e470ca4983babb454acd7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.936519 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28cd9175b16e470ca4983babb454acd7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.967614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28cd9175b16e470ca4983babb454acd7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.976695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28cd9175b16e470ca4983babb454acd7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:19.985883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 937/1887] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:19 2022] DELETE /identity/v3/users/28cd9175b16e470ca4983babb454acd7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:20.679004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:20.680761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:20.700422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb266882-f520-4fab-acdf-c0f0c509ccd4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:20.789459 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:20.790918 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:20.795672 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:20.796478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:20.796853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:20.797252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] PATH_INFO: `/v3/projects/0377bf98ed92481b89cf5b895b421024` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:20.798521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] RBAC: Authorizing `identity:delete_project(project_id=0377bf98ed92481b89cf5b895b421024)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:20.800726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:20.819079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdcac6-330f-4f3a-b294-c1c7606594b5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:20.840205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:20.840946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:20.842459 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:20.843393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] PATH_INFO: `/v3/projects/34160e1768b14f6da223fad369a6e3c4` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:20.847088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34160e1768b14f6da223fad369a6e3c4)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:20.849685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:20.882376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0377bf98ed92481b89cf5b895b421024', 'request_id': 'req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:20.898188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0377bf98ed92481b89cf5b895b421024', 'request_id': 'req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:20.905658 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0377bf98ed92481b89cf5b895b421024', 'request_id': 'req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:20.922080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] The token cache is being invalidate because project 0377bf98ed92481b89cf5b895b421024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:20.922604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:20.924984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f0bbaf7-a0d8-4061-af27-fa81b0eebeed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:20.935759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 951/1888] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:20 2022] DELETE /identity/v3/projects/0377bf98ed92481b89cf5b895b421024 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:20.937301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219653-6ff7-4573-aa82-03a5318aa4ec None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:20.937627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219653-6ff7-4573-aa82-03a5318aa4ec None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:20.938246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219653-6ff7-4573-aa82-03a5318aa4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:20.986188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2b219653-6ff7-4573-aa82-03a5318aa4ec None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:20.989703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2b219653-6ff7-4573-aa82-03a5318aa4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:20.999072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34160e1768b14f6da223fad369a6e3c4', 'request_id': 'req-a581bd8c-40bb-4767-837f-c26f1e096e86'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:21.002622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:21.012896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34160e1768b14f6da223fad369a6e3c4', 'request_id': 'req-a581bd8c-40bb-4767-837f-c26f1e096e86'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:21.030534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34160e1768b14f6da223fad369a6e3c4', 'request_id': 'req-a581bd8c-40bb-4767-837f-c26f1e096e86'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:21.077885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] The token cache is being invalidate because project 34160e1768b14f6da223fad369a6e3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:21.078258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:21.079503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a581bd8c-40bb-4767-837f-c26f1e096e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:21.082283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 938/1889] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:20 2022] DELETE /identity/v3/projects/34160e1768b14f6da223fad369a6e3c4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:21.087367 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ac98b-4c98-474f-b801-2261456b8056 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.087716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ac98b-4c98-474f-b801-2261456b8056 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.087991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ac98b-4c98-474f-b801-2261456b8056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.123391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 952/1890] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:21.131848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e60d-32e9-48a1-83dd-3c5afcdfc57a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.132282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e60d-32e9-48a1-83dd-3c5afcdfc57a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.132973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e60d-32e9-48a1-83dd-3c5afcdfc57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.135113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c88ac98b-4c98-474f-b801-2261456b8056 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:21.136712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c88ac98b-4c98-474f-b801-2261456b8056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:21.147143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 939/1891] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:21.148346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ac98b-4c98-474f-b801-2261456b8056 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.150868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c88ac98b-4c98-474f-b801-2261456b8056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:21.171781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ac98b-4c98-474f-b801-2261456b8056 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.180893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4e26e60d-32e9-48a1-83dd-3c5afcdfc57a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:21.184139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.184830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.185102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.185369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] PATH_INFO: `/v3/projects/840f8566ee4f44708ba15531744ec810` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.186472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4e26e60d-32e9-48a1-83dd-3c5afcdfc57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:21.187947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=840f8566ee4f44708ba15531744ec810)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.189853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.202512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 953/1892] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:21.204164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529cd3-dee5-4c49-b3b8-59e552b8df5a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.204581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529cd3-dee5-4c49-b3b8-59e552b8df5a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.204856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529cd3-dee5-4c49-b3b8-59e552b8df5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.234660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a7529cd3-dee5-4c49-b3b8-59e552b8df5a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:21.236066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a7529cd3-dee5-4c49-b3b8-59e552b8df5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:21.246453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 954/1893] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:21.247497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7529cd3-dee5-4c49-b3b8-59e552b8df5a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.257968 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7529cd3-dee5-4c49-b3b8-59e552b8df5a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.263483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:21.272091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840f8566ee4f44708ba15531744ec810', 'request_id': 'req-ffffa108-75c7-4c01-b8b4-297d1b9c0959'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:21.285970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840f8566ee4f44708ba15531744ec810', 'request_id': 'req-ffffa108-75c7-4c01-b8b4-297d1b9c0959'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:21.293283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840f8566ee4f44708ba15531744ec810', 'request_id': 'req-ffffa108-75c7-4c01-b8b4-297d1b9c0959'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:21.305474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] The token cache is being invalidate because project 840f8566ee4f44708ba15531744ec810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:21.306221 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:21.307082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:21.308880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 940/1894] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:21 2022] DELETE /identity/v3/projects/840f8566ee4f44708ba15531744ec810 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:21.309893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.311634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:21.357289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370c990-508c-4abc-a8a7-97d7396c1823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.357922 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370c990-508c-4abc-a8a7-97d7396c1823 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.358200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370c990-508c-4abc-a8a7-97d7396c1823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.358501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370c990-508c-4abc-a8a7-97d7396c1823 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.359154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370c990-508c-4abc-a8a7-97d7396c1823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:21.359569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370c990-508c-4abc-a8a7-97d7396c1823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.361329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370c990-508c-4abc-a8a7-97d7396c1823 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.378520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 955/1895] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:21.380720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c5f56-cf3a-4bd8-b55b-8ef71ea5c6cc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.381006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c5f56-cf3a-4bd8-b55b-8ef71ea5c6cc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.381409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c5f56-cf3a-4bd8-b55b-8ef71ea5c6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.402134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e41c5f56-cf3a-4bd8-b55b-8ef71ea5c6cc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:21.403131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa108-75c7-4c01-b8b4-297d1b9c0959 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.403348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e41c5f56-cf3a-4bd8-b55b-8ef71ea5c6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:21.408509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226fc16-5f64-4537-9288-6d597830ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.409463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226fc16-5f64-4537-9288-6d597830ac5e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.409978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226fc16-5f64-4537-9288-6d597830ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.410392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226fc16-5f64-4537-9288-6d597830ac5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.411064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 956/1896] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:21.411186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226fc16-5f64-4537-9288-6d597830ac5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:21.411505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226fc16-5f64-4537-9288-6d597830ac5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.411832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c5f56-cf3a-4bd8-b55b-8ef71ea5c6cc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.413009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e41c5f56-cf3a-4bd8-b55b-8ef71ea5c6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:21.413109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226fc16-5f64-4537-9288-6d597830ac5e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.425050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c5f56-cf3a-4bd8-b55b-8ef71ea5c6cc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.427920 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 941/1897] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:21.429660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f4f94-a970-48eb-bb29-41896828361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.430267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f4f94-a970-48eb-bb29-41896828361a admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.430541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f4f94-a970-48eb-bb29-41896828361a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.430804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f4f94-a970-48eb-bb29-41896828361a admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.431461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f4f94-a970-48eb-bb29-41896828361a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.432706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9b9e-eba0-4bcb-a974-f269a4d41727 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.432988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9b9e-eba0-4bcb-a974-f269a4d41727 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.433253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9b9e-eba0-4bcb-a974-f269a4d41727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.433383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f4f94-a970-48eb-bb29-41896828361a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.452935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-13cf9b9e-eba0-4bcb-a974-f269a4d41727 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:21.454129 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-13cf9b9e-eba0-4bcb-a974-f269a4d41727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:21.461949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 942/1898] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:21.462754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf9b9e-eba0-4bcb-a974-f269a4d41727 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.462949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 957/1899] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:21.466410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f4f94-a970-48eb-bb29-41896828361a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.472882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf9b9e-eba0-4bcb-a974-f269a4d41727 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.530932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:21.545004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f4f94-a970-48eb-bb29-41896828361a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.552053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcccd38-1bdc-4f47-a46f-5a93f7bcae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.552739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcccd38-1bdc-4f47-a46f-5a93f7bcae87 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.553184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcccd38-1bdc-4f47-a46f-5a93f7bcae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.553460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcccd38-1bdc-4f47-a46f-5a93f7bcae87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.554126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcccd38-1bdc-4f47-a46f-5a93f7bcae87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:21.554499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcccd38-1bdc-4f47-a46f-5a93f7bcae87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.554997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4df654-8edc-40b3-a9ab-1f58aab99faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.555641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4df654-8edc-40b3-a9ab-1f58aab99faa admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.555917 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4df654-8edc-40b3-a9ab-1f58aab99faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.556176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcccd38-1bdc-4f47-a46f-5a93f7bcae87 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.556805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4df654-8edc-40b3-a9ab-1f58aab99faa admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.557869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4df654-8edc-40b3-a9ab-1f58aab99faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.560019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4df654-8edc-40b3-a9ab-1f58aab99faa admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.575156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 958/1900] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:33:21.576230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcccd38-1bdc-4f47-a46f-5a93f7bcae87 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.587200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcccd38-1bdc-4f47-a46f-5a93f7bcae87 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.592710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e1fc2-40b0-48cb-a569-83b03725c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.593773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e1fc2-40b0-48cb-a569-83b03725c581 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.593773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e1fc2-40b0-48cb-a569-83b03725c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.594001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e1fc2-40b0-48cb-a569-83b03725c581 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.594530 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e1fc2-40b0-48cb-a569-83b03725c581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.597065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e1fc2-40b0-48cb-a569-83b03725c581 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.600199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 943/1901] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:21.601314 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4df654-8edc-40b3-a9ab-1f58aab99faa admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.629747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 959/1902] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/users => generated 291 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:21.630482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e1fc2-40b0-48cb-a569-83b03725c581 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.643293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e1fc2-40b0-48cb-a569-83b03725c581 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.694032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4df654-8edc-40b3-a9ab-1f58aab99faa admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.699151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:21.700199 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9199b-48af-4790-a0bf-0d23b5d5e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.700931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9199b-48af-4790-a0bf-0d23b5d5e8ff admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.702117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9199b-48af-4790-a0bf-0d23b5d5e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.702459 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9199b-48af-4790-a0bf-0d23b5d5e8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.703273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9199b-48af-4790-a0bf-0d23b5d5e8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.705523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9199b-48af-4790-a0bf-0d23b5d5e8ff admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.712758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0d477-f6a4-4fce-af1b-22b3ca458c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.713624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0d477-f6a4-4fce-af1b-22b3ca458c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.713952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0d477-f6a4-4fce-af1b-22b3ca458c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.714273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0d477-f6a4-4fce-af1b-22b3ca458c08 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.715218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0d477-f6a4-4fce-af1b-22b3ca458c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.717742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0d477-f6a4-4fce-af1b-22b3ca458c08 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.739006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 944/1903] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:21.740001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9199b-48af-4790-a0bf-0d23b5d5e8ff admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.747386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 960/1904] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:21.747386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0d477-f6a4-4fce-af1b-22b3ca458c08 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.758202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0d477-f6a4-4fce-af1b-22b3ca458c08 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.815905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9199b-48af-4790-a0bf-0d23b5d5e8ff admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.821284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ecdd-f7da-401c-8fb0-de2e711a0b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.821821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b950b-03cc-4b7a-8322-f0e8653bd3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.821942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ecdd-f7da-401c-8fb0-de2e711a0b92 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.822183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ecdd-f7da-401c-8fb0-de2e711a0b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.822433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b950b-03cc-4b7a-8322-f0e8653bd3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.822544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ecdd-f7da-401c-8fb0-de2e711a0b92 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.822787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b950b-03cc-4b7a-8322-f0e8653bd3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.823033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b950b-03cc-4b7a-8322-f0e8653bd3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.823157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459ecdd-f7da-401c-8fb0-de2e711a0b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.823716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b950b-03cc-4b7a-8322-f0e8653bd3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.825308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b950b-03cc-4b7a-8322-f0e8653bd3a0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.825476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459ecdd-f7da-401c-8fb0-de2e711a0b92 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.841119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 945/1905] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:21.841119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b950b-03cc-4b7a-8322-f0e8653bd3a0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.852041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b950b-03cc-4b7a-8322-f0e8653bd3a0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.856373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 961/1906] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:21 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:21.857434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ecdd-f7da-401c-8fb0-de2e711a0b92 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.861077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b7654-159a-49ac-820a-577138f71713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.861734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b7654-159a-49ac-820a-577138f71713 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.862015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b7654-159a-49ac-820a-577138f71713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.862485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b7654-159a-49ac-820a-577138f71713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.863173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b7654-159a-49ac-820a-577138f71713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.865911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b7654-159a-49ac-820a-577138f71713 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.868791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ecdd-f7da-401c-8fb0-de2e711a0b92 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.874290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e6e51-cf40-4783-87e2-ba3ee2e0c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.875072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6e51-cf40-4783-87e2-ba3ee2e0c0ac admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.875445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6e51-cf40-4783-87e2-ba3ee2e0c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.875664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6e51-cf40-4783-87e2-ba3ee2e0c0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.876315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e6e51-cf40-4783-87e2-ba3ee2e0c0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.878127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e6e51-cf40-4783-87e2-ba3ee2e0c0ac admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.878234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 946/1907] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:21.879155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b7654-159a-49ac-820a-577138f71713 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.890658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b7654-159a-49ac-820a-577138f71713 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.896154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 962/1908] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:21.896154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e6e51-cf40-4783-87e2-ba3ee2e0c0ac admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.899394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411a05-b602-41e4-ba26-802fe0cd271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.900024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411a05-b602-41e4-ba26-802fe0cd271a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.900308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411a05-b602-41e4-ba26-802fe0cd271a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.900567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411a05-b602-41e4-ba26-802fe0cd271a admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.901338 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411a05-b602-41e4-ba26-802fe0cd271a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.902944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411a05-b602-41e4-ba26-802fe0cd271a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.908164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e6e51-cf40-4783-87e2-ba3ee2e0c0ac admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.917217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 947/1909] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:21.917422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010dac1-3d7a-4eca-9eb5-8d9ccb50f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.917536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411a05-b602-41e4-ba26-802fe0cd271a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.917624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010dac1-3d7a-4eca-9eb5-8d9ccb50f54e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.917624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010dac1-3d7a-4eca-9eb5-8d9ccb50f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.917624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010dac1-3d7a-4eca-9eb5-8d9ccb50f54e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.917624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010dac1-3d7a-4eca-9eb5-8d9ccb50f54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.918810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010dac1-3d7a-4eca-9eb5-8d9ccb50f54e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.928545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411a05-b602-41e4-ba26-802fe0cd271a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.933500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 963/1910] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:21.934417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010dac1-3d7a-4eca-9eb5-8d9ccb50f54e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.934524 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede6607-21ac-4000-9e99-8d61ea5b54a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.935168 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede6607-21ac-4000-9e99-8d61ea5b54a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.935535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede6607-21ac-4000-9e99-8d61ea5b54a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.935872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede6607-21ac-4000-9e99-8d61ea5b54a3 admin admin] PATH_INFO: `/v3/projects/7c407f6a1b9244eeb6692e428fbc6a2d/users/8f070893e3064563aeb2838fd2695942/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.947991 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010dac1-3d7a-4eca-9eb5-8d9ccb50f54e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.953005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede6607-21ac-4000-9e99-8d61ea5b54a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c407f6a1b9244eeb6692e428fbc6a2d, user_id=8f070893e3064563aeb2838fd2695942, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.953786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77678272-3c76-418a-9f7f-764cd200f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:21.954353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77678272-3c76-418a-9f7f-764cd200f662 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:21.954629 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77678272-3c76-418a-9f7f-764cd200f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:21.954901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77678272-3c76-418a-9f7f-764cd200f662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:21.955668 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77678272-3c76-418a-9f7f-764cd200f662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:21.957210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede6607-21ac-4000-9e99-8d61ea5b54a3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.957321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77678272-3c76-418a-9f7f-764cd200f662 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:21.969955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 964/1911] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:21.970777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77678272-3c76-418a-9f7f-764cd200f662 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.977870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 948/1912] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:21 2022] PUT /identity/v3/projects/7c407f6a1b9244eeb6692e428fbc6a2d/users/8f070893e3064563aeb2838fd2695942/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:21.979895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede6607-21ac-4000-9e99-8d61ea5b54a3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:21.983641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77678272-3c76-418a-9f7f-764cd200f662 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:21.995266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:22.092001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efaccd-3c64-4bd4-9f1d-ef91402d616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:22.092686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efaccd-3c64-4bd4-9f1d-ef91402d616c admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.092963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efaccd-3c64-4bd4-9f1d-ef91402d616c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.093234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efaccd-3c64-4bd4-9f1d-ef91402d616c admin admin] PATH_INFO: `/v3/projects/950be9990459465287dff83ad3f4964f/users/d1736f62c8b248099bec67b9e45bebac/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.115967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efaccd-3c64-4bd4-9f1d-ef91402d616c admin admin] RBAC: Authorizing `identity:create_grant(project_id=950be9990459465287dff83ad3f4964f, user_id=d1736f62c8b248099bec67b9e45bebac, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:22.118665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efaccd-3c64-4bd4-9f1d-ef91402d616c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:22.152726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede6607-21ac-4000-9e99-8d61ea5b54a3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:22.172181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 965/1913] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:21 2022] PUT /identity/v3/projects/950be9990459465287dff83ad3f4964f/users/d1736f62c8b248099bec67b9e45bebac/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:22.176484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457266ed-8f6d-4185-8850-e954a6b0c0d8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.176834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457266ed-8f6d-4185-8850-e954a6b0c0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.177112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457266ed-8f6d-4185-8850-e954a6b0c0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.213653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-457266ed-8f6d-4185-8850-e954a6b0c0d8 None None] MFA Rules not processed for user `8f070893e3064563aeb2838fd2695942`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:22.214799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-457266ed-8f6d-4185-8850-e954a6b0c0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:22.228469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:22.257588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dc779-4e57-4b48-ae56-6fc7508ba4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:22.258300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc779-4e57-4b48-ae56-6fc7508ba4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.258738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc779-4e57-4b48-ae56-6fc7508ba4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.259126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc779-4e57-4b48-ae56-6fc7508ba4e7 admin admin] PATH_INFO: `/v3/projects/845667c2521d4cd88c644c0ad90d97ea/users/6efa353924bd4a04ae05fadd78d248c6/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.276415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dc779-4e57-4b48-ae56-6fc7508ba4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845667c2521d4cd88c644c0ad90d97ea, user_id=6efa353924bd4a04ae05fadd78d248c6, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:22.279643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dc779-4e57-4b48-ae56-6fc7508ba4e7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:22.312310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 949/1914] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:21 2022] PUT /identity/v3/projects/845667c2521d4cd88c644c0ad90d97ea/users/6efa353924bd4a04ae05fadd78d248c6/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:22.313982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755363c-1bc5-4890-94ee-8c26d31d9d6e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.314468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755363c-1bc5-4890-94ee-8c26d31d9d6e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.314934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755363c-1bc5-4890-94ee-8c26d31d9d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.347553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 966/1915] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:22.351546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a54bed-5902-491a-a401-009288f49718 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.351546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a54bed-5902-491a-a401-009288f49718 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.351546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a54bed-5902-491a-a401-009288f49718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.380406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0755363c-1bc5-4890-94ee-8c26d31d9d6e None None] MFA Rules not processed for user `d1736f62c8b248099bec67b9e45bebac`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:22.381625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0755363c-1bc5-4890-94ee-8c26d31d9d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:22.391431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-62a54bed-5902-491a-a401-009288f49718 None None] MFA Rules not processed for user `6efa353924bd4a04ae05fadd78d248c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:22.392675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-62a54bed-5902-491a-a401-009288f49718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:22.493977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 967/1916] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:22.494948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a54bed-5902-491a-a401-009288f49718 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:22.505220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 950/1917] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:22.505220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755363c-1bc5-4890-94ee-8c26d31d9d6e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:22.545973 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:22.625232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755363c-1bc5-4890-94ee-8c26d31d9d6e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:22.631488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997c05-2545-485a-8d4c-27631bf10640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:22.635601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997c05-2545-485a-8d4c-27631bf10640 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.635909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997c05-2545-485a-8d4c-27631bf10640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.636177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997c05-2545-485a-8d4c-27631bf10640 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.636838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38997c05-2545-485a-8d4c-27631bf10640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:22.647484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a54bed-5902-491a-a401-009288f49718 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:22.649181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38997c05-2545-485a-8d4c-27631bf10640 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:22.668691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eb1b0-b7a4-4bd3-b345-c960b57a703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:22.669307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb1b0-b7a4-4bd3-b345-c960b57a703f admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.669539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb1b0-b7a4-4bd3-b345-c960b57a703f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.669810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb1b0-b7a4-4bd3-b345-c960b57a703f admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.671141 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780eb1b0-b7a4-4bd3-b345-c960b57a703f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:22.673955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780eb1b0-b7a4-4bd3-b345-c960b57a703f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:22.691720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 951/1918] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:22 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:22.692859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997c05-2545-485a-8d4c-27631bf10640 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:22.722978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 968/1919] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:22 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:22.724669 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eb1b0-b7a4-4bd3-b345-c960b57a703f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:22.759418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:22.794117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997c05-2545-485a-8d4c-27631bf10640 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:22.813586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eb1b0-b7a4-4bd3-b345-c960b57a703f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:22.822959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90c03-1f3f-41ea-9759-63d43032c2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:22.823736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90c03-1f3f-41ea-9759-63d43032c2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.823987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90c03-1f3f-41ea-9759-63d43032c2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.824257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90c03-1f3f-41ea-9759-63d43032c2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.824959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b90c03-1f3f-41ea-9759-63d43032c2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:22.827083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b90c03-1f3f-41ea-9759-63d43032c2e4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:22.852935 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 969/1920] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:22 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:22.854027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90c03-1f3f-41ea-9759-63d43032c2e4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:22.868911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90c03-1f3f-41ea-9759-63d43032c2e4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:22.873837 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183791c-20af-4cbf-9946-809577698315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:22.874358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c524198-c106-46e4-9f15-d6c2607f1cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:22.874787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183791c-20af-4cbf-9946-809577698315 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.874962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524198-c106-46e4-9f15-d6c2607f1cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.875240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524198-c106-46e4-9f15-d6c2607f1cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.875358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183791c-20af-4cbf-9946-809577698315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.875552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524198-c106-46e4-9f15-d6c2607f1cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.875779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183791c-20af-4cbf-9946-809577698315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.876192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c524198-c106-46e4-9f15-d6c2607f1cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:22.876575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183791c-20af-4cbf-9946-809577698315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:22.878110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c524198-c106-46e4-9f15-d6c2607f1cb3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:22.879075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183791c-20af-4cbf-9946-809577698315 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:22.902379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 970/1921] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:22 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:22.903231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c524198-c106-46e4-9f15-d6c2607f1cb3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:22.913970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c524198-c106-46e4-9f15-d6c2607f1cb3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:22.921796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7e481-cb11-4b65-b2a7-a6d39677baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:22.923012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7e481-cb11-4b65-b2a7-a6d39677baa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:22.923567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7e481-cb11-4b65-b2a7-a6d39677baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:22.924046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7e481-cb11-4b65-b2a7-a6d39677baa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:22.925261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7e481-cb11-4b65-b2a7-a6d39677baa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:22.928520 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7e481-cb11-4b65-b2a7-a6d39677baa6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:22.932554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 952/1922] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:22 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:22.932554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183791c-20af-4cbf-9946-809577698315 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:22.947353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 971/1923] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:22.948805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7e481-cb11-4b65-b2a7-a6d39677baa6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:22.964386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7e481-cb11-4b65-b2a7-a6d39677baa6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.003373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:23.022231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183791c-20af-4cbf-9946-809577698315 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.027871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d08cc-8ee0-4a17-871e-ed90f69f75bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.028542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d08cc-8ee0-4a17-871e-ed90f69f75bf admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.028826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d08cc-8ee0-4a17-871e-ed90f69f75bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.029100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d08cc-8ee0-4a17-871e-ed90f69f75bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.029820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d08cc-8ee0-4a17-871e-ed90f69f75bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.031470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d08cc-8ee0-4a17-871e-ed90f69f75bf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.037975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11893e-6609-4903-98f7-c9bcd881183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.038588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11893e-6609-4903-98f7-c9bcd881183c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.038861 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11893e-6609-4903-98f7-c9bcd881183c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.039124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11893e-6609-4903-98f7-c9bcd881183c admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.039787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11893e-6609-4903-98f7-c9bcd881183c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.041797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11893e-6609-4903-98f7-c9bcd881183c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.042410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 953/1924] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:23.043051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d08cc-8ee0-4a17-871e-ed90f69f75bf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.054635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d08cc-8ee0-4a17-871e-ed90f69f75bf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.059597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203027b8-642a-489c-b00e-7ded586c2591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.060202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203027b8-642a-489c-b00e-7ded586c2591 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.060509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203027b8-642a-489c-b00e-7ded586c2591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.060718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203027b8-642a-489c-b00e-7ded586c2591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.061496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203027b8-642a-489c-b00e-7ded586c2591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.063385 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203027b8-642a-489c-b00e-7ded586c2591 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.071342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 972/1925] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:22 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:23.071342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11893e-6609-4903-98f7-c9bcd881183c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.075107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 954/1926] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:23.075853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203027b8-642a-489c-b00e-7ded586c2591 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.082552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11893e-6609-4903-98f7-c9bcd881183c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.085720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203027b8-642a-489c-b00e-7ded586c2591 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.087469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a0d0-e12a-49db-9c72-c2036a08b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.088113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a0d0-e12a-49db-9c72-c2036a08b3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.088500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a0d0-e12a-49db-9c72-c2036a08b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.088920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a0d0-e12a-49db-9c72-c2036a08b3bc admin admin] PATH_INFO: `/v3/projects/b788e70ed4044ad5885801c469c16828/users/332332db920044fdb48c0d0425548c10/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.090809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc1162-b056-428c-9da4-d1924990a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.091453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1162-b056-428c-9da4-d1924990a8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.091725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1162-b056-428c-9da4-d1924990a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.091987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1162-b056-428c-9da4-d1924990a8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.092619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc1162-b056-428c-9da4-d1924990a8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.094206 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc1162-b056-428c-9da4-d1924990a8cf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.104396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 955/1927] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:23.104565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346a0d0-e12a-49db-9c72-c2036a08b3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b788e70ed4044ad5885801c469c16828, user_id=332332db920044fdb48c0d0425548c10, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.105305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc1162-b056-428c-9da4-d1924990a8cf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.107358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346a0d0-e12a-49db-9c72-c2036a08b3bc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.115475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc1162-b056-428c-9da4-d1924990a8cf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.122936 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 973/1928] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:23 2022] PUT /identity/v3/projects/b788e70ed4044ad5885801c469c16828/users/332332db920044fdb48c0d0425548c10/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:23.123768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a0d0-e12a-49db-9c72-c2036a08b3bc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.172853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3e0d1-ea3d-414b-b446-c93517851d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.173518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3e0d1-ea3d-414b-b446-c93517851d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.173793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3e0d1-ea3d-414b-b446-c93517851d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.174051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3e0d1-ea3d-414b-b446-c93517851d92 admin admin] PATH_INFO: `/v3/projects/91632454b0ad42549229994117be4efa/users/04d0b20abff34315a4044dfbbedde410/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.176962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:23.190722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3e0d1-ea3d-414b-b446-c93517851d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91632454b0ad42549229994117be4efa, user_id=04d0b20abff34315a4044dfbbedde410, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.191609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a0d0-e12a-49db-9c72-c2036a08b3bc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.193410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3e0d1-ea3d-414b-b446-c93517851d92 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.196908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4fafe-a0b8-4aad-8533-05d9c6182f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.197558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fafe-a0b8-4aad-8533-05d9c6182f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.198825 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fafe-a0b8-4aad-8533-05d9c6182f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.199098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fafe-a0b8-4aad-8533-05d9c6182f62 admin admin] PATH_INFO: `/v3/projects/29097d88afa04d2ab45e32c80c3716a8/users/ed46cf9eb9c14ee3aca5cde8c4a85108/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.207911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 956/1929] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:23 2022] PUT /identity/v3/projects/91632454b0ad42549229994117be4efa/users/04d0b20abff34315a4044dfbbedde410/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:23.208840 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3e0d1-ea3d-414b-b446-c93517851d92 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.224608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4fafe-a0b8-4aad-8533-05d9c6182f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29097d88afa04d2ab45e32c80c3716a8, user_id=ed46cf9eb9c14ee3aca5cde8c4a85108, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.227623 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4fafe-a0b8-4aad-8533-05d9c6182f62 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.242440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 974/1930] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:23 2022] PUT /identity/v3/projects/29097d88afa04d2ab45e32c80c3716a8/users/ed46cf9eb9c14ee3aca5cde8c4a85108/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:23.244601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1bdc-dfce-4f47-96e4-08d6e92be051 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.245234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1bdc-dfce-4f47-96e4-08d6e92be051 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.245728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1bdc-dfce-4f47-96e4-08d6e92be051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.275510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-28af1bdc-dfce-4f47-96e4-08d6e92be051 None None] MFA Rules not processed for user `04d0b20abff34315a4044dfbbedde410`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:23.276842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-28af1bdc-dfce-4f47-96e4-08d6e92be051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:23.284826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3e0d1-ea3d-414b-b446-c93517851d92 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.332852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:23.348550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215127ec-d35c-4397-a83e-99fe0f1ef7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.349258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215127ec-d35c-4397-a83e-99fe0f1ef7ff admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.349598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215127ec-d35c-4397-a83e-99fe0f1ef7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.349931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215127ec-d35c-4397-a83e-99fe0f1ef7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.350654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215127ec-d35c-4397-a83e-99fe0f1ef7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.352588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215127ec-d35c-4397-a83e-99fe0f1ef7ff admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.361393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 975/1931] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:23.362073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af1bdc-dfce-4f47-96e4-08d6e92be051 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.367680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 957/1932] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:23.368516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215127ec-d35c-4397-a83e-99fe0f1ef7ff admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.374002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af1bdc-dfce-4f47-96e4-08d6e92be051 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.378585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215127ec-d35c-4397-a83e-99fe0f1ef7ff admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.378896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d583c6-26a3-497e-92f6-7f97b6335add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.379550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d583c6-26a3-497e-92f6-7f97b6335add admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.379829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d583c6-26a3-497e-92f6-7f97b6335add admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.380095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d583c6-26a3-497e-92f6-7f97b6335add admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.380748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d583c6-26a3-497e-92f6-7f97b6335add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.382529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d583c6-26a3-497e-92f6-7f97b6335add admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.383290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041020e-fceb-40a6-817b-c2acc77e6901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.383961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041020e-fceb-40a6-817b-c2acc77e6901 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.384231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041020e-fceb-40a6-817b-c2acc77e6901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.384503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041020e-fceb-40a6-817b-c2acc77e6901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.385137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041020e-fceb-40a6-817b-c2acc77e6901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.387109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041020e-fceb-40a6-817b-c2acc77e6901 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.395130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 976/1933] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:23.395903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d583c6-26a3-497e-92f6-7f97b6335add admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.406702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d583c6-26a3-497e-92f6-7f97b6335add admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.412282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e028c0-d7f9-49de-91b7-b5ac1668ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.412957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e028c0-d7f9-49de-91b7-b5ac1668ea79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.413290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e028c0-d7f9-49de-91b7-b5ac1668ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.413599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e028c0-d7f9-49de-91b7-b5ac1668ea79 admin admin] PATH_INFO: `/v3/projects/b788e70ed4044ad5885801c469c16828/users/332332db920044fdb48c0d0425548c10/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.415773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e028c0-d7f9-49de-91b7-b5ac1668ea79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b788e70ed4044ad5885801c469c16828, user_id=332332db920044fdb48c0d0425548c10, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.418477 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e028c0-d7f9-49de-91b7-b5ac1668ea79 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.421031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 958/1934] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:23 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:23.421975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041020e-fceb-40a6-817b-c2acc77e6901 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.435734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 977/1935] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:23 2022] PUT /identity/v3/projects/b788e70ed4044ad5885801c469c16828/users/332332db920044fdb48c0d0425548c10/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:23.436957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e028c0-d7f9-49de-91b7-b5ac1668ea79 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.502234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041020e-fceb-40a6-817b-c2acc77e6901 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.506352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e028c0-d7f9-49de-91b7-b5ac1668ea79 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.507251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8354c-5df0-4e10-9464-a603a521ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.508386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8354c-5df0-4e10-9464-a603a521ba70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.508877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8354c-5df0-4e10-9464-a603a521ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.509327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8354c-5df0-4e10-9464-a603a521ba70 admin admin] PATH_INFO: `/v3/projects/29097d88afa04d2ab45e32c80c3716a8/users/ed46cf9eb9c14ee3aca5cde8c4a85108/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.511375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1808c-3f23-446d-87dd-890c97dd2885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.511967 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8354c-5df0-4e10-9464-a603a521ba70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29097d88afa04d2ab45e32c80c3716a8, user_id=ed46cf9eb9c14ee3aca5cde8c4a85108, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.512063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1808c-3f23-446d-87dd-890c97dd2885 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.512246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1808c-3f23-446d-87dd-890c97dd2885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.512513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1808c-3f23-446d-87dd-890c97dd2885 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.513143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1808c-3f23-446d-87dd-890c97dd2885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.514988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8354c-5df0-4e10-9464-a603a521ba70 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.515082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1808c-3f23-446d-87dd-890c97dd2885 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.525406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 959/1936] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:23 2022] PUT /identity/v3/projects/29097d88afa04d2ab45e32c80c3716a8/users/ed46cf9eb9c14ee3aca5cde8c4a85108/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:23.527635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67aef8a-b00f-4938-b8e1-33b85c1116be None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.527863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67aef8a-b00f-4938-b8e1-33b85c1116be None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.528134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67aef8a-b00f-4938-b8e1-33b85c1116be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.542273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 978/1937] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:23 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:23.543988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8de2-c80c-44c9-ba21-56e33e321b80 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.544266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8de2-c80c-44c9-ba21-56e33e321b80 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.544532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8de2-c80c-44c9-ba21-56e33e321b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.556726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f67aef8a-b00f-4938-b8e1-33b85c1116be None None] MFA Rules not processed for user `332332db920044fdb48c0d0425548c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:23.558112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f67aef8a-b00f-4938-b8e1-33b85c1116be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:23.572537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-758b8de2-c80c-44c9-ba21-56e33e321b80 None None] MFA Rules not processed for user `ed46cf9eb9c14ee3aca5cde8c4a85108`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:23.574356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-758b8de2-c80c-44c9-ba21-56e33e321b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:23.594543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:23.638253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 960/1938] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:23.642042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67aef8a-b00f-4938-b8e1-33b85c1116be None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.664948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 979/1939] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:23.664948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b8de2-c80c-44c9-ba21-56e33e321b80 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.664948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-758b8de2-c80c-44c9-ba21-56e33e321b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:23.709063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:23.735213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67aef8a-b00f-4938-b8e1-33b85c1116be None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.742268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829435-f102-4be6-b6c4-79ae142bf900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.742731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b8de2-c80c-44c9-ba21-56e33e321b80 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.743202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829435-f102-4be6-b6c4-79ae142bf900 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.743202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829435-f102-4be6-b6c4-79ae142bf900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.743493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829435-f102-4be6-b6c4-79ae142bf900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.744161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52829435-f102-4be6-b6c4-79ae142bf900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.746334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52829435-f102-4be6-b6c4-79ae142bf900 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.746511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41513-88c7-4396-b94f-90aa5e97c981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.747183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41513-88c7-4396-b94f-90aa5e97c981 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.747494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41513-88c7-4396-b94f-90aa5e97c981 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.747803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41513-88c7-4396-b94f-90aa5e97c981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.757455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 961/1940] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:23.758724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a41513-88c7-4396-b94f-90aa5e97c981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.760612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a41513-88c7-4396-b94f-90aa5e97c981 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.761502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829435-f102-4be6-b6c4-79ae142bf900 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.764018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-52829435-f102-4be6-b6c4-79ae142bf900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:23.772819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 980/1941] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:23.773954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41513-88c7-4396-b94f-90aa5e97c981 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.777567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829435-f102-4be6-b6c4-79ae142bf900 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.781939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dce84-9b62-4285-8965-818f47997815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.782443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dce84-9b62-4285-8965-818f47997815 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.782679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dce84-9b62-4285-8965-818f47997815 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.782951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dce84-9b62-4285-8965-818f47997815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.784956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41513-88c7-4396-b94f-90aa5e97c981 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.789680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e43a4-ba11-4f4d-8c7d-4d5c05c7093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:23.790348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e43a4-ba11-4f4d-8c7d-4d5c05c7093e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:23.790625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e43a4-ba11-4f4d-8c7d-4d5c05c7093e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:23.790892 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e43a4-ba11-4f4d-8c7d-4d5c05c7093e admin admin] PATH_INFO: `/v3/projects/df82455e62df41ecb504d078de9af67d/users/426688a90a324ca9bdb55422d18b47c7/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:23.793823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dce84-9b62-4285-8965-818f47997815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.795888 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dce84-9b62-4285-8965-818f47997815 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.809897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e43a4-ba11-4f4d-8c7d-4d5c05c7093e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df82455e62df41ecb504d078de9af67d, user_id=426688a90a324ca9bdb55422d18b47c7, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:23.811951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 962/1942] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:23.812777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e43a4-ba11-4f4d-8c7d-4d5c05c7093e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:23.836764 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 981/1943] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:23 2022] PUT /identity/v3/projects/df82455e62df41ecb504d078de9af67d/users/426688a90a324ca9bdb55422d18b47c7/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:23.841321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dce84-9b62-4285-8965-818f47997815 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:23.855012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dce84-9b62-4285-8965-818f47997815 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:23.967829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e43a4-ba11-4f4d-8c7d-4d5c05c7093e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:24.000696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada790ac-38ca-4f0e-b1fb-51ba7c1d3bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:24.001602 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada790ac-38ca-4f0e-b1fb-51ba7c1d3bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:24.001882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada790ac-38ca-4f0e-b1fb-51ba7c1d3bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:24.002377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada790ac-38ca-4f0e-b1fb-51ba7c1d3bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:24.002848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada790ac-38ca-4f0e-b1fb-51ba7c1d3bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:24.004558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada790ac-38ca-4f0e-b1fb-51ba7c1d3bd2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:24.028263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 963/1944] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:24.028263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada790ac-38ca-4f0e-b1fb-51ba7c1d3bd2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:24.044180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada790ac-38ca-4f0e-b1fb-51ba7c1d3bd2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:24.051462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e43a4-ba11-4f4d-8c7d-4d5c05c7093e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:24.052316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45d8f4-01d8-42ae-ad1b-ace69c9ea65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:24.053207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45d8f4-01d8-42ae-ad1b-ace69c9ea65f admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:24.053555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45d8f4-01d8-42ae-ad1b-ace69c9ea65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:24.053828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45d8f4-01d8-42ae-ad1b-ace69c9ea65f admin admin] PATH_INFO: `/v3/projects/df82455e62df41ecb504d078de9af67d/users/426688a90a324ca9bdb55422d18b47c7/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:24.055773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45d8f4-01d8-42ae-ad1b-ace69c9ea65f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df82455e62df41ecb504d078de9af67d, user_id=426688a90a324ca9bdb55422d18b47c7, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:24.056866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b27b-b228-4ddf-a226-ae1dc051e820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:24.058457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b27b-b228-4ddf-a226-ae1dc051e820 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:24.058951 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b27b-b228-4ddf-a226-ae1dc051e820 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:24.059192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45d8f4-01d8-42ae-ad1b-ace69c9ea65f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:24.059689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b27b-b228-4ddf-a226-ae1dc051e820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:24.073657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 964/1945] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:24 2022] PUT /identity/v3/projects/df82455e62df41ecb504d078de9af67d/users/426688a90a324ca9bdb55422d18b47c7/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:24.094237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0af1-c775-433e-abfd-a2861a9067bd None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:24.097681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0af1-c775-433e-abfd-a2861a9067bd None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:24.097963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0af1-c775-433e-abfd-a2861a9067bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:24.162717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:24.176378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5d9d0af1-c775-433e-abfd-a2861a9067bd None None] MFA Rules not processed for user `426688a90a324ca9bdb55422d18b47c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:24.177971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5d9d0af1-c775-433e-abfd-a2861a9067bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:24.187883 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197b27b-b228-4ddf-a226-ae1dc051e820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:24.190241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197b27b-b228-4ddf-a226-ae1dc051e820 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:24.201695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 982/1946] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:24.277426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 965/1947] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:24.323601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b27b-b228-4ddf-a226-ae1dc051e820 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:24.336412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b27b-b228-4ddf-a226-ae1dc051e820 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:24.397334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e8942-51e7-4603-9880-264492a23404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:24.397967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e8942-51e7-4603-9880-264492a23404 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:24.398239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e8942-51e7-4603-9880-264492a23404 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:24.398534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e8942-51e7-4603-9880-264492a23404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:24.409446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e8942-51e7-4603-9880-264492a23404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:24.410917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e8942-51e7-4603-9880-264492a23404 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:24.422283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 983/1948] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:24.829226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d0af1-c775-433e-abfd-a2861a9067bd None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:24.845976 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e8942-51e7-4603-9880-264492a23404 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:24.878308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:24.939964 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d0af1-c775-433e-abfd-a2861a9067bd None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:24.941749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e8942-51e7-4603-9880-264492a23404 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:24.945146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:24.945798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:24.946072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:24.946340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] PATH_INFO: `/v3/users/8f070893e3064563aeb2838fd2695942` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:24.946669 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:24.947417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:24.947679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f070893e3064563aeb2838fd2695942)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:24.947822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:24.948234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] PATH_INFO: `/v3/users/d1736f62c8b248099bec67b9e45bebac` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:24.949620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1736f62c8b248099bec67b9e45bebac)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:24.950069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:24.951740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:25.034593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1736f62c8b248099bec67b9e45bebac'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:25.048618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f070893e3064563aeb2838fd2695942'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:25.049649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f070893e3064563aeb2838fd2695942'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:25.061778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1736f62c8b248099bec67b9e45bebac'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:25.067608 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f070893e3064563aeb2838fd2695942'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:25.078789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1736f62c8b248099bec67b9e45bebac'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:25.080078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1736f62c8b248099bec67b9e45bebac'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:25.088476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2132147b-3406-4fab-9091-9cbe13aee240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1736f62c8b248099bec67b9e45bebac'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:25.094343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f070893e3064563aeb2838fd2695942'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:25.096961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 984/1949] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:24 2022] DELETE /identity/v3/users/d1736f62c8b248099bec67b9e45bebac => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:25.101317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1551b0-6764-49d0-90f7-e7e8795cbff3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:25.102490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1551b0-6764-49d0-90f7-e7e8795cbff3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:25.102840 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1551b0-6764-49d0-90f7-e7e8795cbff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:25.104859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c29558d5-f3ec-4642-a31d-765c06ce97b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f070893e3064563aeb2838fd2695942'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:25.116868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 966/1950] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:24 2022] DELETE /identity/v3/users/8f070893e3064563aeb2838fd2695942 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:25.121934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2395f2e-2365-40dd-b523-a7506a4e6744 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:25.122368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2395f2e-2365-40dd-b523-a7506a4e6744 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:25.122780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2395f2e-2365-40dd-b523-a7506a4e6744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:25.144961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6a1551b0-6764-49d0-90f7-e7e8795cbff3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:25.146317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6a1551b0-6764-49d0-90f7-e7e8795cbff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:25.147934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e2395f2e-2365-40dd-b523-a7506a4e6744 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:25.149112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e2395f2e-2365-40dd-b523-a7506a4e6744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:25.157165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:25.254072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 985/1951] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:25.261285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 967/1952] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:25.264463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1551b0-6764-49d0-90f7-e7e8795cbff3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:25.266288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6a1551b0-6764-49d0-90f7-e7e8795cbff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:25.273006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2395f2e-2365-40dd-b523-a7506a4e6744 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:25.276076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e2395f2e-2365-40dd-b523-a7506a4e6744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:25.366212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1551b0-6764-49d0-90f7-e7e8795cbff3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:25.367133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2395f2e-2365-40dd-b523-a7506a4e6744 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:25.370154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30262064-22a4-4288-9a89-4f4611781a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:25.370772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30262064-22a4-4288-9a89-4f4611781a00 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:25.371043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30262064-22a4-4288-9a89-4f4611781a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:25.371336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30262064-22a4-4288-9a89-4f4611781a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:25.371741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0747cd-442a-4d6a-8fab-260df5fa6b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:25.372355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0747cd-442a-4d6a-8fab-260df5fa6b14 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:25.372633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0747cd-442a-4d6a-8fab-260df5fa6b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:25.372901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0747cd-442a-4d6a-8fab-260df5fa6b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:25.379117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:25.381235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30262064-22a4-4288-9a89-4f4611781a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:25.383281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0747cd-442a-4d6a-8fab-260df5fa6b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:25.383437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30262064-22a4-4288-9a89-4f4611781a00 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:25.387746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0747cd-442a-4d6a-8fab-260df5fa6b14 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:25.393270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 986/1953] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:25.394176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30262064-22a4-4288-9a89-4f4611781a00 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:25.395604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-30262064-22a4-4288-9a89-4f4611781a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:25.400076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 968/1954] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:25.453305 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30262064-22a4-4288-9a89-4f4611781a00 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:25.456896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee75d9-cca4-4c6a-9048-1d952f507b52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:25.457523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee75d9-cca4-4c6a-9048-1d952f507b52 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:25.457799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee75d9-cca4-4c6a-9048-1d952f507b52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:25.458067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee75d9-cca4-4c6a-9048-1d952f507b52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:25.459911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c7ee75d9-cca4-4c6a-9048-1d952f507b52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:25.530147 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee75d9-cca4-4c6a-9048-1d952f507b52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:25.531619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee75d9-cca4-4c6a-9048-1d952f507b52 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:25.548174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 987/1955] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:26.082954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0747cd-442a-4d6a-8fab-260df5fa6b14 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:26.085546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7e0747cd-442a-4d6a-8fab-260df5fa6b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:26.107101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0747cd-442a-4d6a-8fab-260df5fa6b14 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:26.123343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:26.124535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:26.125254 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:26.125998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] PATH_INFO: `/v3/projects/7c407f6a1b9244eeb6692e428fbc6a2d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:26.135059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee75d9-cca4-4c6a-9048-1d952f507b52 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:26.136738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c7ee75d9-cca4-4c6a-9048-1d952f507b52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:26.139960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c407f6a1b9244eeb6692e428fbc6a2d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:26.142406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:26.152185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee75d9-cca4-4c6a-9048-1d952f507b52 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:26.158168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:26.158794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:26.159078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:26.159379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] PATH_INFO: `/v3/projects/950be9990459465287dff83ad3f4964f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:26.160506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950be9990459465287dff83ad3f4964f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:26.162419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:26.164146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:26.200606 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c407f6a1b9244eeb6692e428fbc6a2d', 'request_id': 'req-31a04ac6-5b05-450f-948f-4f2c4897a80e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.210442 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c407f6a1b9244eeb6692e428fbc6a2d', 'request_id': 'req-31a04ac6-5b05-450f-948f-4f2c4897a80e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.219817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950be9990459465287dff83ad3f4964f', 'request_id': 'req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.226059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c407f6a1b9244eeb6692e428fbc6a2d', 'request_id': 'req-31a04ac6-5b05-450f-948f-4f2c4897a80e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.231926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950be9990459465287dff83ad3f4964f', 'request_id': 'req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.240202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950be9990459465287dff83ad3f4964f', 'request_id': 'req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.246516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] The token cache is being invalidate because project 7c407f6a1b9244eeb6692e428fbc6a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:26.246836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.247641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.249935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 969/1956] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:26 2022] DELETE /identity/v3/projects/7c407f6a1b9244eeb6692e428fbc6a2d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:26.254085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:26.255663 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:26.255786 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] The token cache is being invalidate because project 950be9990459465287dff83ad3f4964f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:26.256037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.261591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.261591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 988/1957] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:26 2022] DELETE /identity/v3/projects/950be9990459465287dff83ad3f4964f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:26.262642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:26.264246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:26.350368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04ac6-5b05-450f-948f-4f2c4897a80e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:26.355653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:26.356246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:26.356520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:26.356805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] PATH_INFO: `/v3/users/332332db920044fdb48c0d0425548c10` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:26.357931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332332db920044fdb48c0d0425548c10)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:26.359182 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e50d6-63bb-444d-87a5-4a4f0f27a9e6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:26.359928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:26.364549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:26.365225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:26.365522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:26.365799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] PATH_INFO: `/v3/users/ed46cf9eb9c14ee3aca5cde8c4a85108` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:26.366965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed46cf9eb9c14ee3aca5cde8c4a85108)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:26.369607 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:26.423488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332332db920044fdb48c0d0425548c10'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.424393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332332db920044fdb48c0d0425548c10'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.434864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332332db920044fdb48c0d0425548c10'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.451483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332332db920044fdb48c0d0425548c10'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.456019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed46cf9eb9c14ee3aca5cde8c4a85108'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.458044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:26.461001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332332db920044fdb48c0d0425548c10'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.467832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed46cf9eb9c14ee3aca5cde8c4a85108'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.474704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 970/1958] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:26 2022] DELETE /identity/v3/users/332332db920044fdb48c0d0425548c10 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:26.483521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed46cf9eb9c14ee3aca5cde8c4a85108'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.484752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed46cf9eb9c14ee3aca5cde8c4a85108'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.494214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed46cf9eb9c14ee3aca5cde8c4a85108'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:26.501159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 989/1959] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:26 2022] DELETE /identity/v3/users/ed46cf9eb9c14ee3aca5cde8c4a85108 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:27.141572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:27.143236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.243273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:27.244775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.260748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057762-1549-4fed-85b2-1032882c0529 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:27.271494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:27.363154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979cc2-3629-479b-86d5-998629eb9327 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:27.365759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:27.366443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.366715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.366998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] PATH_INFO: `/v3/projects/29097d88afa04d2ab45e32c80c3716a8` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.368224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:27.368345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29097d88afa04d2ab45e32c80c3716a8)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:27.368866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.369140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.369416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] PATH_INFO: `/v3/projects/b788e70ed4044ad5885801c469c16828` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.370853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:27.370969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b788e70ed4044ad5885801c469c16828)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:27.373002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:27.424904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b788e70ed4044ad5885801c469c16828', 'request_id': 'req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.431351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29097d88afa04d2ab45e32c80c3716a8', 'request_id': 'req-8514b1d3-27c2-47a2-8962-e66dfbd488d8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.433353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b788e70ed4044ad5885801c469c16828', 'request_id': 'req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.439680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b788e70ed4044ad5885801c469c16828', 'request_id': 'req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.439823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29097d88afa04d2ab45e32c80c3716a8', 'request_id': 'req-8514b1d3-27c2-47a2-8962-e66dfbd488d8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.446025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29097d88afa04d2ab45e32c80c3716a8', 'request_id': 'req-8514b1d3-27c2-47a2-8962-e66dfbd488d8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.451710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] The token cache is being invalidate because project b788e70ed4044ad5885801c469c16828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:27.451996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.452632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.454723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 990/1960] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:27 2022] DELETE /identity/v3/projects/b788e70ed4044ad5885801c469c16828 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:27.455356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:27.456747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.457958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] The token cache is being invalidate because project 29097d88afa04d2ab45e32c80c3716a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:27.458249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.458898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8514b1d3-27c2-47a2-8962-e66dfbd488d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.460589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 971/1961] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:27 2022] DELETE /identity/v3/projects/29097d88afa04d2ab45e32c80c3716a8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:27.461702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4904b-5c33-4c35-bb2b-6558c4bf614b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.461984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4904b-5c33-4c35-bb2b-6558c4bf614b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.462253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4904b-5c33-4c35-bb2b-6558c4bf614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.482246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-efe4904b-5c33-4c35-bb2b-6558c4bf614b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:27.483494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-efe4904b-5c33-4c35-bb2b-6558c4bf614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.514950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:27.528133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06d6ed-98ef-4e20-a3ea-4cd8229fbe7c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:27.551731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 972/1962] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:27.553003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37d636-7b4d-44f5-9c6c-bc3e8e2cca07 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.553291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37d636-7b4d-44f5-9c6c-bc3e8e2cca07 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.553563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37d636-7b4d-44f5-9c6c-bc3e8e2cca07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.574141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8a37d636-7b4d-44f5-9c6c-bc3e8e2cca07 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:27.575370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8a37d636-7b4d-44f5-9c6c-bc3e8e2cca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.582286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:27.584155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 973/1963] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:27.585625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bce8e2-c38e-4520-8d43-7db7bdce9988 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.585908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bce8e2-c38e-4520-8d43-7db7bdce9988 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.586165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bce8e2-c38e-4520-8d43-7db7bdce9988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.597751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:27.598710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.599450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.599865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] PATH_INFO: `/v3/users/21b8fcac7f194553ba50aadbda74e31e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.601495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b8fcac7f194553ba50aadbda74e31e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:27.603961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:27.607562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a6bce8e2-c38e-4520-8d43-7db7bdce9988 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:27.608756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a6bce8e2-c38e-4520-8d43-7db7bdce9988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.618985 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 974/1964] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:27.620092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800fc51-dc18-46d1-b963-996b657b8713 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.620365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800fc51-dc18-46d1-b963-996b657b8713 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.620947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800fc51-dc18-46d1-b963-996b657b8713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.644166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5800fc51-dc18-46d1-b963-996b657b8713 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:27.645454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5800fc51-dc18-46d1-b963-996b657b8713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.659451 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 975/1965] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:27.659451 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800fc51-dc18-46d1-b963-996b657b8713 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:27.663239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b8fcac7f194553ba50aadbda74e31e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.669622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800fc51-dc18-46d1-b963-996b657b8713 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:27.674908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e02f3d-4a15-4c92-a5b7-1f704939db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:27.675555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e02f3d-4a15-4c92-a5b7-1f704939db1e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.675830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e02f3d-4a15-4c92-a5b7-1f704939db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.676064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b8fcac7f194553ba50aadbda74e31e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.676183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e02f3d-4a15-4c92-a5b7-1f704939db1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.676735 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e02f3d-4a15-4c92-a5b7-1f704939db1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:27.677034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e02f3d-4a15-4c92-a5b7-1f704939db1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:27.678778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e02f3d-4a15-4c92-a5b7-1f704939db1e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:27.693679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b8fcac7f194553ba50aadbda74e31e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.695511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 976/1966] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:27.696509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b8fcac7f194553ba50aadbda74e31e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.698680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e02f3d-4a15-4c92-a5b7-1f704939db1e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:27.701800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-76e02f3d-4a15-4c92-a5b7-1f704939db1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.708734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b8fcac7f194553ba50aadbda74e31e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:27.721741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e02f3d-4a15-4c92-a5b7-1f704939db1e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:27.723824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 991/1967] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:27 2022] DELETE /identity/v3/users/21b8fcac7f194553ba50aadbda74e31e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:27.724819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:27.726260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.792660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298e55c-364b-40e5-a326-ce8077dd9756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:27.793310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298e55c-364b-40e5-a326-ce8077dd9756 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.793582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298e55c-364b-40e5-a326-ce8077dd9756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.793849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298e55c-364b-40e5-a326-ce8077dd9756 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.794491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298e55c-364b-40e5-a326-ce8077dd9756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:27.794807 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298e55c-364b-40e5-a326-ce8077dd9756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:27.796410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298e55c-364b-40e5-a326-ce8077dd9756 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:27.806658 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eec247-15b3-4fe3-8b74-3566b142127e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:27.808802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 977/1968] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:27.810007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf44c0d-9669-40f2-9cc5-99e24dc85ef3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.810280 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf44c0d-9669-40f2-9cc5-99e24dc85ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.810546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf44c0d-9669-40f2-9cc5-99e24dc85ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.812454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c7a44-72f9-43cf-b6f7-5c4a1e92b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:27.812929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c7a44-72f9-43cf-b6f7-5c4a1e92b9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.813204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c7a44-72f9-43cf-b6f7-5c4a1e92b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.813472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c7a44-72f9-43cf-b6f7-5c4a1e92b9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.814113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c7a44-72f9-43cf-b6f7-5c4a1e92b9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:27.816055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c7a44-72f9-43cf-b6f7-5c4a1e92b9e9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:27.832321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5bf44c0d-9669-40f2-9cc5-99e24dc85ef3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:27.833653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5bf44c0d-9669-40f2-9cc5-99e24dc85ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.842406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 978/1969] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:27.843412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf44c0d-9669-40f2-9cc5-99e24dc85ef3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:27.853955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf44c0d-9669-40f2-9cc5-99e24dc85ef3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:27.855012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 992/1970] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:27 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:27.856024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c7a44-72f9-43cf-b6f7-5c4a1e92b9e9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:27.860411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-087c7a44-72f9-43cf-b6f7-5c4a1e92b9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:27.946907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af1f54-6f75-4abb-8672-67c370524252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:27.947791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af1f54-6f75-4abb-8672-67c370524252 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.948067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af1f54-6f75-4abb-8672-67c370524252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.948335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af1f54-6f75-4abb-8672-67c370524252 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.948549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c7a44-72f9-43cf-b6f7-5c4a1e92b9e9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:27.951927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af1f54-6f75-4abb-8672-67c370524252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:27.953141 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbf205-63ce-485d-bfc5-f575fe9269b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:27.953832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbf205-63ce-485d-bfc5-f575fe9269b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:27.954176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbf205-63ce-485d-bfc5-f575fe9269b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:27.954288 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af1f54-6f75-4abb-8672-67c370524252 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:27.954565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbf205-63ce-485d-bfc5-f575fe9269b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:27.961320 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:27.965811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbf205-63ce-485d-bfc5-f575fe9269b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:27.968774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbf205-63ce-485d-bfc5-f575fe9269b0 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:27.986116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 993/1971] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:27.987516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbf205-63ce-485d-bfc5-f575fe9269b0 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.000431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbf205-63ce-485d-bfc5-f575fe9269b0 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.005300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e4986-1886-4277-979d-4d40ca4afae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.005911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e4986-1886-4277-979d-4d40ca4afae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.006199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e4986-1886-4277-979d-4d40ca4afae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.006454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e4986-1886-4277-979d-4d40ca4afae8 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.007077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e4986-1886-4277-979d-4d40ca4afae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.009614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e4986-1886-4277-979d-4d40ca4afae8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.022241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 979/1972] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:27 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:28.023270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af1f54-6f75-4abb-8672-67c370524252 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.047031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:28.059332 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 994/1973] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:27 2022] POST /identity/v3/users => generated 286 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:28.059332 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e4986-1886-4277-979d-4d40ca4afae8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.079207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e4986-1886-4277-979d-4d40ca4afae8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.147920 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af1f54-6f75-4abb-8672-67c370524252 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.153869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255b7db-ce46-47b2-90ff-22f06407fb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.155392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b7db-ce46-47b2-90ff-22f06407fb39 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.155679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b7db-ce46-47b2-90ff-22f06407fb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.155948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b7db-ce46-47b2-90ff-22f06407fb39 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.156635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255b7db-ce46-47b2-90ff-22f06407fb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.158567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255b7db-ce46-47b2-90ff-22f06407fb39 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.190991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 980/1974] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:28 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:28.192003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e377cc-1aef-4a3c-9bf7-227e2b1f01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.192649 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e377cc-1aef-4a3c-9bf7-227e2b1f01f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.192917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e377cc-1aef-4a3c-9bf7-227e2b1f01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.193182 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e377cc-1aef-4a3c-9bf7-227e2b1f01f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.195395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255b7db-ce46-47b2-90ff-22f06407fb39 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.195731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e377cc-1aef-4a3c-9bf7-227e2b1f01f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.200335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e377cc-1aef-4a3c-9bf7-227e2b1f01f5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.209588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255b7db-ce46-47b2-90ff-22f06407fb39 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.215456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06928fee-358a-4d4e-802a-14bd65e38a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.216139 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06928fee-358a-4d4e-802a-14bd65e38a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.217563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06928fee-358a-4d4e-802a-14bd65e38a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.217842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06928fee-358a-4d4e-802a-14bd65e38a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.219471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06928fee-358a-4d4e-802a-14bd65e38a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.220636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06928fee-358a-4d4e-802a-14bd65e38a66 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.227531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 995/1975] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:28.228483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e377cc-1aef-4a3c-9bf7-227e2b1f01f5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.243358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e377cc-1aef-4a3c-9bf7-227e2b1f01f5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.249273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2109e-2826-439d-b506-c658f40d4422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.249902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2109e-2826-439d-b506-c658f40d4422 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.250179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2109e-2826-439d-b506-c658f40d4422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.250447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2109e-2826-439d-b506-c658f40d4422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.251099 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2109e-2826-439d-b506-c658f40d4422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.251376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 981/1976] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:28.253073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2109e-2826-439d-b506-c658f40d4422 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.253188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06928fee-358a-4d4e-802a-14bd65e38a66 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.271162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06928fee-358a-4d4e-802a-14bd65e38a66 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.274645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 996/1977] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:28.276337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2109e-2826-439d-b506-c658f40d4422 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.278272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036db0ba-fc99-4679-839b-dd5e34c80185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.279435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036db0ba-fc99-4679-839b-dd5e34c80185 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.279720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036db0ba-fc99-4679-839b-dd5e34c80185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.279998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036db0ba-fc99-4679-839b-dd5e34c80185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.280651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036db0ba-fc99-4679-839b-dd5e34c80185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.282332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036db0ba-fc99-4679-839b-dd5e34c80185 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.289494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2109e-2826-439d-b506-c658f40d4422 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.294883 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f4fc4-caf6-4f6b-814b-33cdf9d652bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.295621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f4fc4-caf6-4f6b-814b-33cdf9d652bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.296045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f4fc4-caf6-4f6b-814b-33cdf9d652bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.296319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f4fc4-caf6-4f6b-814b-33cdf9d652bf admin admin] PATH_INFO: `/v3/projects/ca2b6448e9194c57b626385dfff1dfbc/users/f6830941e8744052ad8f12964e42d8d7/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.298959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 982/1978] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:28.303021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036db0ba-fc99-4679-839b-dd5e34c80185 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.315507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f4fc4-caf6-4f6b-814b-33cdf9d652bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2b6448e9194c57b626385dfff1dfbc, user_id=f6830941e8744052ad8f12964e42d8d7, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.319564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036db0ba-fc99-4679-839b-dd5e34c80185 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.322977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f4fc4-caf6-4f6b-814b-33cdf9d652bf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.324962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58542f-d506-4b52-9ddb-75a2460bf0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.327349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58542f-d506-4b52-9ddb-75a2460bf0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.327349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58542f-d506-4b52-9ddb-75a2460bf0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.327349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58542f-d506-4b52-9ddb-75a2460bf0aa admin admin] PATH_INFO: `/v3/projects/1c3031c3a7da42adabcab66e9e64d0ff/users/b63d96aa7ec24827b46bbe016f0c5ff7/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.345272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 997/1979] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:28 2022] PUT /identity/v3/projects/ca2b6448e9194c57b626385dfff1dfbc/users/f6830941e8744052ad8f12964e42d8d7/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:28.355613 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58542f-d506-4b52-9ddb-75a2460bf0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3031c3a7da42adabcab66e9e64d0ff, user_id=b63d96aa7ec24827b46bbe016f0c5ff7, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.355966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf93ae5-d371-4a84-9729-1427aac9101a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.356256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf93ae5-d371-4a84-9729-1427aac9101a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.356503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf93ae5-d371-4a84-9729-1427aac9101a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.358594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58542f-d506-4b52-9ddb-75a2460bf0aa admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.398948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1cf93ae5-d371-4a84-9729-1427aac9101a None None] MFA Rules not processed for user `f6830941e8744052ad8f12964e42d8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:28.401220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1cf93ae5-d371-4a84-9729-1427aac9101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:28.403587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 983/1980] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:28 2022] PUT /identity/v3/projects/1c3031c3a7da42adabcab66e9e64d0ff/users/b63d96aa7ec24827b46bbe016f0c5ff7/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:28.415552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c814af4-7ce9-4ae1-b64b-3e037fbdc209 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.415862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c814af4-7ce9-4ae1-b64b-3e037fbdc209 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.416101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c814af4-7ce9-4ae1-b64b-3e037fbdc209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.453137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5c814af4-7ce9-4ae1-b64b-3e037fbdc209 None None] MFA Rules not processed for user `b63d96aa7ec24827b46bbe016f0c5ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:28.456045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5c814af4-7ce9-4ae1-b64b-3e037fbdc209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:28.490445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 998/1981] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:28.491438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf93ae5-d371-4a84-9729-1427aac9101a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.492934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1cf93ae5-d371-4a84-9729-1427aac9101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:28.536083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:28.551054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 984/1982] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:28.553546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c814af4-7ce9-4ae1-b64b-3e037fbdc209 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.558738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5c814af4-7ce9-4ae1-b64b-3e037fbdc209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:28.589804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf93ae5-d371-4a84-9729-1427aac9101a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.595339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.596004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.596284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.596556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] PATH_INFO: `/v3/projects/f26ad9a1cc174b519a0c6eb0598be238` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.597707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26ad9a1cc174b519a0c6eb0598be238)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.599818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.637844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:28.672605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26ad9a1cc174b519a0c6eb0598be238', 'request_id': 'req-37407a57-b655-4875-b924-e5bdf617dcbd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:28.676319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c814af4-7ce9-4ae1-b64b-3e037fbdc209 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.684564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26ad9a1cc174b519a0c6eb0598be238', 'request_id': 'req-37407a57-b655-4875-b924-e5bdf617dcbd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:28.694004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26ad9a1cc174b519a0c6eb0598be238', 'request_id': 'req-37407a57-b655-4875-b924-e5bdf617dcbd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:28.708994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] The token cache is being invalidate because project f26ad9a1cc174b519a0c6eb0598be238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:28.709317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:28.710731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:28.715730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 999/1983] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:28 2022] DELETE /identity/v3/projects/f26ad9a1cc174b519a0c6eb0598be238 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:28.717009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.718703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:28.747998 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8507df2-0eed-44c2-a7e3-b581bd9ae41f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '457880195ed849d2b594ddea6acdf7df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.748892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507df2-0eed-44c2-a7e3-b581bd9ae41f service glance] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.749752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507df2-0eed-44c2-a7e3-b581bd9ae41f service glance] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.750025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507df2-0eed-44c2-a7e3-b581bd9ae41f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.754594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f8507df2-0eed-44c2-a7e3-b581bd9ae41f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:28.835678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37407a57-b655-4875-b924-e5bdf617dcbd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.841581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123030b1-5238-4fec-9443-deda36fc97d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.841787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123030b1-5238-4fec-9443-deda36fc97d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.842044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123030b1-5238-4fec-9443-deda36fc97d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.842310 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123030b1-5238-4fec-9443-deda36fc97d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.842952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123030b1-5238-4fec-9443-deda36fc97d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.844949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123030b1-5238-4fec-9443-deda36fc97d1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.849474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8507df2-0eed-44c2-a7e3-b581bd9ae41f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.851410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8507df2-0eed-44c2-a7e3-b581bd9ae41f service glance] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.870814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 985/1984] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:28.871654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8507df2-0eed-44c2-a7e3-b581bd9ae41f service glance] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.873128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f8507df2-0eed-44c2-a7e3-b581bd9ae41f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:28.878871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1000/1985] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:28 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:28.883088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123030b1-5238-4fec-9443-deda36fc97d1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:28.902827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8507df2-0eed-44c2-a7e3-b581bd9ae41f service glance] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.940295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:28.965991 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123030b1-5238-4fec-9443-deda36fc97d1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:28.972031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0643d6-95bf-451f-bd72-7e475f6c9427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.974599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0643d6-95bf-451f-bd72-7e475f6c9427 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.974889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0643d6-95bf-451f-bd72-7e475f6c9427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.975248 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0643d6-95bf-451f-bd72-7e475f6c9427 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.975929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0643d6-95bf-451f-bd72-7e475f6c9427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:28.977911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0643d6-95bf-451f-bd72-7e475f6c9427 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:28.996276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:28.996794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:28.997124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:28.997678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] PATH_INFO: `/v3/users/ab2367dff422440d83df758706979e86` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:28.998896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2367dff422440d83df758706979e86)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:29.000972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:29.017919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1001/1986] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:28 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:29.021849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0643d6-95bf-451f-bd72-7e475f6c9427 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:29.033290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0643d6-95bf-451f-bd72-7e475f6c9427 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:29.038490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a666-18c9-4da9-9b7b-a9ca66fd62dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:29.039107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a666-18c9-4da9-9b7b-a9ca66fd62dd admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.039438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a666-18c9-4da9-9b7b-a9ca66fd62dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.039687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a666-18c9-4da9-9b7b-a9ca66fd62dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.040345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2a666-18c9-4da9-9b7b-a9ca66fd62dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:29.042559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2a666-18c9-4da9-9b7b-a9ca66fd62dd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:29.060085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1002/1987] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:29.061127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a666-18c9-4da9-9b7b-a9ca66fd62dd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:29.067376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:29.078924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a666-18c9-4da9-9b7b-a9ca66fd62dd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:29.082006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2367dff422440d83df758706979e86'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:29.082679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2367dff422440d83df758706979e86'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:29.090304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718b68-d7b9-4fa1-8524-4f9ccbc1ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:29.090992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718b68-d7b9-4fa1-8524-4f9ccbc1ffef admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.091256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718b68-d7b9-4fa1-8524-4f9ccbc1ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.091708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718b68-d7b9-4fa1-8524-4f9ccbc1ffef admin admin] PATH_INFO: `/v3/projects/1940fbfebefc421da90898311d4afc34/users/8520bba995a644b29c6fcb89c10d833a/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.097766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2367dff422440d83df758706979e86'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:29.112981 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2367dff422440d83df758706979e86'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:29.115709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9718b68-d7b9-4fa1-8524-4f9ccbc1ffef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1940fbfebefc421da90898311d4afc34, user_id=8520bba995a644b29c6fcb89c10d833a, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:29.118560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9718b68-d7b9-4fa1-8524-4f9ccbc1ffef admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:29.122954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2367dff422440d83df758706979e86'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:29.130081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 986/1988] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:28 2022] DELETE /identity/v3/users/ab2367dff422440d83df758706979e86 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:29.143497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1003/1989] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:29 2022] PUT /identity/v3/projects/1940fbfebefc421da90898311d4afc34/users/8520bba995a644b29c6fcb89c10d833a/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:29.147599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:29.149075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:29.236307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2a223-57b9-4485-baf0-461ef7c5e061 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:29.345453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a3b69-76fe-4a08-9f1d-d2ef12ea2ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:29.346003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a3b69-76fe-4a08-9f1d-d2ef12ea2ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.346277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a3b69-76fe-4a08-9f1d-d2ef12ea2ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.346541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a3b69-76fe-4a08-9f1d-d2ef12ea2ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.347785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a3b69-76fe-4a08-9f1d-d2ef12ea2ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:29.349531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a3b69-76fe-4a08-9f1d-d2ef12ea2ed9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:29.362842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 987/1990] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:29.367083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718b68-d7b9-4fa1-8524-4f9ccbc1ffef admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:29.387965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718b68-d7b9-4fa1-8524-4f9ccbc1ffef admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:29.394175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad80cb-1ff5-4288-aabb-4a51d6ad1192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:29.395095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad80cb-1ff5-4288-aabb-4a51d6ad1192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.395473 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad80cb-1ff5-4288-aabb-4a51d6ad1192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.395877 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad80cb-1ff5-4288-aabb-4a51d6ad1192 admin admin] PATH_INFO: `/v3/projects/1940fbfebefc421da90898311d4afc34/users/8520bba995a644b29c6fcb89c10d833a/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.398154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad80cb-1ff5-4288-aabb-4a51d6ad1192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1940fbfebefc421da90898311d4afc34, user_id=8520bba995a644b29c6fcb89c10d833a, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:29.401674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad80cb-1ff5-4288-aabb-4a51d6ad1192 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:29.429281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66962d00-2af5-474f-8a9c-783b31c75dd4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.429518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66962d00-2af5-474f-8a9c-783b31c75dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.429785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66962d00-2af5-474f-8a9c-783b31c75dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.432777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1004/1991] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:29 2022] PUT /identity/v3/projects/1940fbfebefc421da90898311d4afc34/users/8520bba995a644b29c6fcb89c10d833a/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:29.476150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-66962d00-2af5-474f-8a9c-783b31c75dd4 None None] MFA Rules not processed for user `8520bba995a644b29c6fcb89c10d833a`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:29.478425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-66962d00-2af5-474f-8a9c-783b31c75dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:29.533770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad80cb-1ff5-4288-aabb-4a51d6ad1192 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:29.535681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ccad80cb-1ff5-4288-aabb-4a51d6ad1192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:29.564152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:29.609241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 988/1992] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:29.622229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66962d00-2af5-474f-8a9c-783b31c75dd4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:29.623987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-66962d00-2af5-474f-8a9c-783b31c75dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:29.657586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad80cb-1ff5-4288-aabb-4a51d6ad1192 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:29.664018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:29.664667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.664942 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.665512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] PATH_INFO: `/v3/projects/7741342ffaa54133a8a1a11b4690b203` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.666698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7741342ffaa54133a8a1a11b4690b203)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:29.668770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:29.701651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66962d00-2af5-474f-8a9c-783b31c75dd4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:29.706193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e2f65-904e-46ec-8aac-e6e13a5bedaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:29.706821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2f65-904e-46ec-8aac-e6e13a5bedaa service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.707096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2f65-904e-46ec-8aac-e6e13a5bedaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.707390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2f65-904e-46ec-8aac-e6e13a5bedaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.709125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6c4e2f65-904e-46ec-8aac-e6e13a5bedaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:29.721916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7741342ffaa54133a8a1a11b4690b203', 'request_id': 'req-79454772-8a3b-4230-aa93-d6a36b7b7d82'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:29.734131 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7741342ffaa54133a8a1a11b4690b203', 'request_id': 'req-79454772-8a3b-4230-aa93-d6a36b7b7d82'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:29.742233 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7741342ffaa54133a8a1a11b4690b203', 'request_id': 'req-79454772-8a3b-4230-aa93-d6a36b7b7d82'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:29.754539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] The token cache is being invalidate because project 7741342ffaa54133a8a1a11b4690b203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:29.754855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:29.755912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-79454772-8a3b-4230-aa93-d6a36b7b7d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:29.760999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1005/1993] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:29 2022] DELETE /identity/v3/projects/7741342ffaa54133a8a1a11b4690b203 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:29.763012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70b1c-8639-4548-ad54-139672a6203f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.763394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70b1c-8639-4548-ad54-139672a6203f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.763601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70b1c-8639-4548-ad54-139672a6203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.785301 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e2f65-904e-46ec-8aac-e6e13a5bedaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:29.787040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e2f65-904e-46ec-8aac-e6e13a5bedaa service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:29.787151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bdf70b1c-8639-4548-ad54-139672a6203f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:29.788361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bdf70b1c-8639-4548-ad54-139672a6203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:29.796879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 989/1994] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:29.800891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:29.867629 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1006/1995] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:29.870046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb9cb1-9d1b-4aa1-a5b7-ec41faf6da10 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.870327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb9cb1-9d1b-4aa1-a5b7-ec41faf6da10 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.870596 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb9cb1-9d1b-4aa1-a5b7-ec41faf6da10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.895784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5ccb9cb1-9d1b-4aa1-a5b7-ec41faf6da10 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:29.896985 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5ccb9cb1-9d1b-4aa1-a5b7-ec41faf6da10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:29.906112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 990/1996] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:29.910509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf70b1c-8639-4548-ad54-139672a6203f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:29.921552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf70b1c-8639-4548-ad54-139672a6203f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:29.927072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e203a-0ee5-49a8-b99f-d51c760a46f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:29.928095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e203a-0ee5-49a8-b99f-d51c760a46f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.928513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e203a-0ee5-49a8-b99f-d51c760a46f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.928792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e203a-0ee5-49a8-b99f-d51c760a46f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.929446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e203a-0ee5-49a8-b99f-d51c760a46f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:29.929748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e203a-0ee5-49a8-b99f-d51c760a46f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:29.933149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e203a-0ee5-49a8-b99f-d51c760a46f3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:29.955408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1007/1997] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:29.956479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb9cb1-9d1b-4aa1-a5b7-ec41faf6da10 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:29.968759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb9cb1-9d1b-4aa1-a5b7-ec41faf6da10 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:29.976430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb864009-5173-4d22-b75d-67bad29eb279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:29.979474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb864009-5173-4d22-b75d-67bad29eb279 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:29.980002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb864009-5173-4d22-b75d-67bad29eb279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:29.980468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb864009-5173-4d22-b75d-67bad29eb279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:29.981914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb864009-5173-4d22-b75d-67bad29eb279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:29.984255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb864009-5173-4d22-b75d-67bad29eb279 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:30.040778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 991/1998] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:29 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:30.045659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e203a-0ee5-49a8-b99f-d51c760a46f3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:30.058673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e203a-0ee5-49a8-b99f-d51c760a46f3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:30.231492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb864009-5173-4d22-b75d-67bad29eb279 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:30.234507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cb864009-5173-4d22-b75d-67bad29eb279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:30.277230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d06bf7-fd8d-4830-ab72-e8d01cf3a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:30.278215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d06bf7-fd8d-4830-ab72-e8d01cf3a1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:30.278965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d06bf7-fd8d-4830-ab72-e8d01cf3a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:30.280016 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d06bf7-fd8d-4830-ab72-e8d01cf3a1aa admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:30.281063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d06bf7-fd8d-4830-ab72-e8d01cf3a1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:30.298013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d06bf7-fd8d-4830-ab72-e8d01cf3a1aa admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:30.379184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1008/1999] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:30 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:30.383062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d06bf7-fd8d-4830-ab72-e8d01cf3a1aa admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:30.397928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d06bf7-fd8d-4830-ab72-e8d01cf3a1aa admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:30.408497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98e002-fe4e-433d-bdd7-0c33461179ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:30.409296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98e002-fe4e-433d-bdd7-0c33461179ec admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:30.409582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98e002-fe4e-433d-bdd7-0c33461179ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:30.409854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98e002-fe4e-433d-bdd7-0c33461179ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:30.410874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98e002-fe4e-433d-bdd7-0c33461179ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:30.413095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98e002-fe4e-433d-bdd7-0c33461179ec admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:30.428239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1009/2000] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:30.428972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb864009-5173-4d22-b75d-67bad29eb279 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:30.434088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98e002-fe4e-433d-bdd7-0c33461179ec admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:30.440143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01568a10-b1ae-4f6d-81d8-e7bbb099ccaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:30.440792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568a10-b1ae-4f6d-81d8-e7bbb099ccaf service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:30.441046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568a10-b1ae-4f6d-81d8-e7bbb099ccaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:30.441315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568a10-b1ae-4f6d-81d8-e7bbb099ccaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:30.445264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-01568a10-b1ae-4f6d-81d8-e7bbb099ccaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:30.446513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98e002-fe4e-433d-bdd7-0c33461179ec admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:30.474399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224237e-e45c-4fb9-9856-48cf205b6ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:30.475567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224237e-e45c-4fb9-9856-48cf205b6ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:30.476170 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224237e-e45c-4fb9-9856-48cf205b6ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:30.476763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224237e-e45c-4fb9-9856-48cf205b6ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:30.477689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224237e-e45c-4fb9-9856-48cf205b6ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:30.480820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224237e-e45c-4fb9-9856-48cf205b6ea7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:30.493680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1010/2001] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:30.498029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224237e-e45c-4fb9-9856-48cf205b6ea7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:30.509648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:30.514149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224237e-e45c-4fb9-9856-48cf205b6ea7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:30.521366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf1fd8-c432-4229-b073-d711e474f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:30.522124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf1fd8-c432-4229-b073-d711e474f659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:30.522495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf1fd8-c432-4229-b073-d711e474f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:30.522937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf1fd8-c432-4229-b073-d711e474f659 admin admin] PATH_INFO: `/v3/projects/632381b5d73349a8b266d612fd8b9176/users/2d6ea8525af3424cb78bd270e6ccb67b/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:30.540884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf1fd8-c432-4229-b073-d711e474f659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=632381b5d73349a8b266d612fd8b9176, user_id=2d6ea8525af3424cb78bd270e6ccb67b, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:30.544430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf1fd8-c432-4229-b073-d711e474f659 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:30.553369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01568a10-b1ae-4f6d-81d8-e7bbb099ccaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:30.554944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01568a10-b1ae-4f6d-81d8-e7bbb099ccaf service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:30.567345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1011/2002] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:30 2022] PUT /identity/v3/projects/632381b5d73349a8b266d612fd8b9176/users/2d6ea8525af3424cb78bd270e6ccb67b/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:30.569633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 992/2003] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:33:30.580983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd17c8-b944-46fe-b9fe-283afdb3ea43 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:30.581218 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd17c8-b944-46fe-b9fe-283afdb3ea43 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:30.581515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd17c8-b944-46fe-b9fe-283afdb3ea43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:30.628030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-43bd17c8-b944-46fe-b9fe-283afdb3ea43 None None] MFA Rules not processed for user `2d6ea8525af3424cb78bd270e6ccb67b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:30.629994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-43bd17c8-b944-46fe-b9fe-283afdb3ea43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:30.678638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:30.758718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1012/2004] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:30.764158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01568a10-b1ae-4f6d-81d8-e7bbb099ccaf service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:30.783092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01568a10-b1ae-4f6d-81d8-e7bbb099ccaf service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:30.857994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed06e7-0fc9-4142-81e6-24f3f36194fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:30.858272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed06e7-0fc9-4142-81e6-24f3f36194fd admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:30.858553 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed06e7-0fc9-4142-81e6-24f3f36194fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:30.858835 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed06e7-0fc9-4142-81e6-24f3f36194fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:30.859502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed06e7-0fc9-4142-81e6-24f3f36194fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:30.863008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed06e7-0fc9-4142-81e6-24f3f36194fd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:30.899599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 993/2005] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:30 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:30.907260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd17c8-b944-46fe-b9fe-283afdb3ea43 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:30.919146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd17c8-b944-46fe-b9fe-283afdb3ea43 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:31.014740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7845517-d195-44b6-b7ae-f4e0c1e4c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:31.016029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7845517-d195-44b6-b7ae-f4e0c1e4c28a admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:31.016532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7845517-d195-44b6-b7ae-f4e0c1e4c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:31.016998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7845517-d195-44b6-b7ae-f4e0c1e4c28a admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:31.018049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7845517-d195-44b6-b7ae-f4e0c1e4c28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:31.028966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7845517-d195-44b6-b7ae-f4e0c1e4c28a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:31.099496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1013/2006] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:30 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:31.102207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed06e7-0fc9-4142-81e6-24f3f36194fd admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:31.131937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed06e7-0fc9-4142-81e6-24f3f36194fd admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:31.139717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14b8d4-b19f-4128-b6e2-27623434d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:31.140402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14b8d4-b19f-4128-b6e2-27623434d445 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:31.140931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14b8d4-b19f-4128-b6e2-27623434d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:31.144746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14b8d4-b19f-4128-b6e2-27623434d445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:31.147265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14b8d4-b19f-4128-b6e2-27623434d445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:31.151782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14b8d4-b19f-4128-b6e2-27623434d445 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:31.176469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 994/2007] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:31.177039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7845517-d195-44b6-b7ae-f4e0c1e4c28a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:31.191053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7845517-d195-44b6-b7ae-f4e0c1e4c28a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:31.203775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9af06-4af8-4ea0-92c1-3aeeac7253dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:31.206860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9af06-4af8-4ea0-92c1-3aeeac7253dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:31.206860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9af06-4af8-4ea0-92c1-3aeeac7253dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:31.207084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9af06-4af8-4ea0-92c1-3aeeac7253dd admin admin] PATH_INFO: `/v3/projects/5dd0e727be1e41729bb86e6d650a0b51/users/c7a0743edfa5429cbb769258b60c6726/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:31.235064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9af06-4af8-4ea0-92c1-3aeeac7253dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd0e727be1e41729bb86e6d650a0b51, user_id=c7a0743edfa5429cbb769258b60c6726, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:31.237668 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9af06-4af8-4ea0-92c1-3aeeac7253dd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:31.254568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1014/2008] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:31 2022] PUT /identity/v3/projects/5dd0e727be1e41729bb86e6d650a0b51/users/c7a0743edfa5429cbb769258b60c6726/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:31.258438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14b8d4-b19f-4128-b6e2-27623434d445 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:31.270666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14b8d4-b19f-4128-b6e2-27623434d445 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:31.375827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f794e7-bdd3-4271-a8e2-76d085e4c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:31.376781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f794e7-bdd3-4271-a8e2-76d085e4c195 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:31.377318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f794e7-bdd3-4271-a8e2-76d085e4c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:31.377681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f794e7-bdd3-4271-a8e2-76d085e4c195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:31.378433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f794e7-bdd3-4271-a8e2-76d085e4c195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:31.380245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f794e7-bdd3-4271-a8e2-76d085e4c195 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:31.410922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 995/2009] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:31.412375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9af06-4af8-4ea0-92c1-3aeeac7253dd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:31.432202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9af06-4af8-4ea0-92c1-3aeeac7253dd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:31.454493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddd786-4800-4bf6-9b87-0fdb92e1161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:31.455203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddd786-4800-4bf6-9b87-0fdb92e1161c admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:31.455531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddd786-4800-4bf6-9b87-0fdb92e1161c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:31.455845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddd786-4800-4bf6-9b87-0fdb92e1161c admin admin] PATH_INFO: `/v3/projects/5dd0e727be1e41729bb86e6d650a0b51/users/c7a0743edfa5429cbb769258b60c6726/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:31.458011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddd786-4800-4bf6-9b87-0fdb92e1161c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd0e727be1e41729bb86e6d650a0b51, user_id=c7a0743edfa5429cbb769258b60c6726, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:31.461139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddd786-4800-4bf6-9b87-0fdb92e1161c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:31.485280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1015/2010] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:31 2022] PUT /identity/v3/projects/5dd0e727be1e41729bb86e6d650a0b51/users/c7a0743edfa5429cbb769258b60c6726/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:31.501071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8fdb8-faa1-4222-915e-789b9bfd8df7 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:31.501356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8fdb8-faa1-4222-915e-789b9bfd8df7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:31.501616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8fdb8-faa1-4222-915e-789b9bfd8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:31.551487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a5e8fdb8-faa1-4222-915e-789b9bfd8df7 None None] MFA Rules not processed for user `c7a0743edfa5429cbb769258b60c6726`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:31.553261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a5e8fdb8-faa1-4222-915e-789b9bfd8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:31.614615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:31.690029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 996/2011] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:31.853448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddd786-4800-4bf6-9b87-0fdb92e1161c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:31.940130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddd786-4800-4bf6-9b87-0fdb92e1161c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:31.950162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c462e-b48a-461b-856c-897b83bb3008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:31.951967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c462e-b48a-461b-856c-897b83bb3008 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:31.952484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c462e-b48a-461b-856c-897b83bb3008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:31.953531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c462e-b48a-461b-856c-897b83bb3008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:31.978493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c462e-b48a-461b-856c-897b83bb3008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:31.981102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c462e-b48a-461b-856c-897b83bb3008 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:31.995691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1016/2012] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:32.034433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8fdb8-faa1-4222-915e-789b9bfd8df7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:32.134589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8fdb8-faa1-4222-915e-789b9bfd8df7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:32.141053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:32.141718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:32.141990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:32.142251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] PATH_INFO: `/v3/users/2d6ea8525af3424cb78bd270e6ccb67b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:32.143661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6ea8525af3424cb78bd270e6ccb67b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:32.145727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:32.196950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6ea8525af3424cb78bd270e6ccb67b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:32.197756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6ea8525af3424cb78bd270e6ccb67b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:32.208313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6ea8525af3424cb78bd270e6ccb67b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:32.221765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6ea8525af3424cb78bd270e6ccb67b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:32.229129 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6ea8525af3424cb78bd270e6ccb67b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:32.235955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 997/2013] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:32 2022] DELETE /identity/v3/users/2d6ea8525af3424cb78bd270e6ccb67b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:32.241104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667734bd-14f0-462c-a952-984425ce1b14 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:32.241462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667734bd-14f0-462c-a952-984425ce1b14 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:32.241741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667734bd-14f0-462c-a952-984425ce1b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:32.262523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-667734bd-14f0-462c-a952-984425ce1b14 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:32.263901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-667734bd-14f0-462c-a952-984425ce1b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:32.289383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:32.336840 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1017/2014] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:32.346946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:32.348477 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:32.400190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:32.415544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b77e3-1ba2-40b8-a533-9ec9a5ed733c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:32.420013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea37c2-bbb1-49ae-9c9a-1ffd2759688d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:32.420730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea37c2-bbb1-49ae-9c9a-1ffd2759688d service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:32.421030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea37c2-bbb1-49ae-9c9a-1ffd2759688d service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:32.421421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea37c2-bbb1-49ae-9c9a-1ffd2759688d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:32.431768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea37c2-bbb1-49ae-9c9a-1ffd2759688d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:32.433318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea37c2-bbb1-49ae-9c9a-1ffd2759688d service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:32.443040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 998/2015] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:33:32.717374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667734bd-14f0-462c-a952-984425ce1b14 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:32.720641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-667734bd-14f0-462c-a952-984425ce1b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:32.736228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667734bd-14f0-462c-a952-984425ce1b14 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:32.742732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:32.743728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:32.743728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:32.743962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] PATH_INFO: `/v3/projects/632381b5d73349a8b266d612fd8b9176` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:32.745530 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=632381b5d73349a8b266d612fd8b9176)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:32.747680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:32.811381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632381b5d73349a8b266d612fd8b9176', 'request_id': 'req-1ed57295-e3fa-4b24-851c-04c1fb238d70'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:32.822019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632381b5d73349a8b266d612fd8b9176', 'request_id': 'req-1ed57295-e3fa-4b24-851c-04c1fb238d70'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:32.830787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632381b5d73349a8b266d612fd8b9176', 'request_id': 'req-1ed57295-e3fa-4b24-851c-04c1fb238d70'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:32.849020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] The token cache is being invalidate because project 632381b5d73349a8b266d612fd8b9176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:32.849325 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:32.849983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:32.852161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1018/2016] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:32 2022] DELETE /identity/v3/projects/632381b5d73349a8b266d612fd8b9176 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:32.856567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea37c2-bbb1-49ae-9c9a-1ffd2759688d service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:32.866943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea37c2-bbb1-49ae-9c9a-1ffd2759688d service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:32.946193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:32.946841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:32.947118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:32.947795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] PATH_INFO: `/v3/users/c7a0743edfa5429cbb769258b60c6726` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:32.949217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a0743edfa5429cbb769258b60c6726)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:32.952476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:33.020453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a0743edfa5429cbb769258b60c6726'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.021111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a0743edfa5429cbb769258b60c6726'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.030965 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a0743edfa5429cbb769258b60c6726'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.047569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a0743edfa5429cbb769258b60c6726'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.055433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a0743edfa5429cbb769258b60c6726'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.064315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 999/2017] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:32 2022] DELETE /identity/v3/users/c7a0743edfa5429cbb769258b60c6726 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:33.256017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:33.257812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:33.281928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57295-e3fa-4b24-851c-04c1fb238d70 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:33.455962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:33.457623 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:33.457910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:33.458186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] PATH_INFO: `/v3/users/b63d96aa7ec24827b46bbe016f0c5ff7` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:33.464412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63d96aa7ec24827b46bbe016f0c5ff7)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:33.466416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:33.605729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63d96aa7ec24827b46bbe016f0c5ff7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.617439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:33.620246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:33.636511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63d96aa7ec24827b46bbe016f0c5ff7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.640431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:33.642987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e7ecf-7589-44b1-b7de-274c01c8c1a3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:33.655944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:33.657795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:33.657795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:33.658948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] PATH_INFO: `/v3/users/6efa353924bd4a04ae05fadd78d248c6` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:33.662142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efa353924bd4a04ae05fadd78d248c6)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:33.663931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:33.668342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63d96aa7ec24827b46bbe016f0c5ff7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.669072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63d96aa7ec24827b46bbe016f0c5ff7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.678642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1853006d-4066-4f51-94c7-f8afadf637e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63d96aa7ec24827b46bbe016f0c5ff7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.687374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1019/2018] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:33 2022] DELETE /identity/v3/users/b63d96aa7ec24827b46bbe016f0c5ff7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:33.690480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad625b-2a9f-40dc-9a57-9685c554d269 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:33.691043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad625b-2a9f-40dc-9a57-9685c554d269 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:33.691269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad625b-2a9f-40dc-9a57-9685c554d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:33.712186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1fad625b-2a9f-40dc-9a57-9685c554d269 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:33.715933 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1fad625b-2a9f-40dc-9a57-9685c554d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:33.774892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efa353924bd4a04ae05fadd78d248c6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.775802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efa353924bd4a04ae05fadd78d248c6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.785516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efa353924bd4a04ae05fadd78d248c6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.790077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1020/2019] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:33.790733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:33.791224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad625b-2a9f-40dc-9a57-9685c554d269 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:33.792721 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1fad625b-2a9f-40dc-9a57-9685c554d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:33.805149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad625b-2a9f-40dc-9a57-9685c554d269 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:33.811034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:33.811872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:33.812149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:33.812416 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] PATH_INFO: `/v3/projects/5dd0e727be1e41729bb86e6d650a0b51` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:33.813644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd0e727be1e41729bb86e6d650a0b51)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:33.815696 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:33.820093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efa353924bd4a04ae05fadd78d248c6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.828378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efa353924bd4a04ae05fadd78d248c6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.835914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1000/2020] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:33 2022] DELETE /identity/v3/users/6efa353924bd4a04ae05fadd78d248c6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:33.836571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:33.837925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:33.885911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd0e727be1e41729bb86e6d650a0b51', 'request_id': 'req-7c123858-bbae-4a98-9d0c-26b69e968dea'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.897574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd0e727be1e41729bb86e6d650a0b51', 'request_id': 'req-7c123858-bbae-4a98-9d0c-26b69e968dea'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.910860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd0e727be1e41729bb86e6d650a0b51', 'request_id': 'req-7c123858-bbae-4a98-9d0c-26b69e968dea'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.924566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53a96-d339-4305-869f-4bc153ed18d2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:33.924747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] The token cache is being invalidate because project 5dd0e727be1e41729bb86e6d650a0b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:33.924861 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.928783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c123858-bbae-4a98-9d0c-26b69e968dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:33.929731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1021/2021] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:33 2022] DELETE /identity/v3/projects/5dd0e727be1e41729bb86e6d650a0b51 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:33.931105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf7c09-2abc-49ee-be85-8ba1b3c6ac4f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:33.931417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf7c09-2abc-49ee-be85-8ba1b3c6ac4f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:33.931692 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf7c09-2abc-49ee-be85-8ba1b3c6ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:33.952945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1acf7c09-2abc-49ee-be85-8ba1b3c6ac4f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:33.954216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1acf7c09-2abc-49ee-be85-8ba1b3c6ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:33.985637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c0ef0-81cb-4466-8313-27eed9e066c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:33.986721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c0ef0-81cb-4466-8313-27eed9e066c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:33.987143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c0ef0-81cb-4466-8313-27eed9e066c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:33.987737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c0ef0-81cb-4466-8313-27eed9e066c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:33.990014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-653c0ef0-81cb-4466-8313-27eed9e066c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:34.016868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:34.031689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1022/2022] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:34.033493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b0a34-38bf-4ab3-ad17-8108ddbdd00b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.034159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b0a34-38bf-4ab3-ad17-8108ddbdd00b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.040427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b0a34-38bf-4ab3-ad17-8108ddbdd00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.065387 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-540b0a34-38bf-4ab3-ad17-8108ddbdd00b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:34.066607 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-540b0a34-38bf-4ab3-ad17-8108ddbdd00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:34.076140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1023/2023] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:34.077187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b0a34-38bf-4ab3-ad17-8108ddbdd00b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:34.078494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-540b0a34-38bf-4ab3-ad17-8108ddbdd00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:34.089479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c0ef0-81cb-4466-8313-27eed9e066c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:34.091188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c0ef0-81cb-4466-8313-27eed9e066c1 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:34.091599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b0a34-38bf-4ab3-ad17-8108ddbdd00b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:34.095668 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92799c9-3275-499b-b1e9-e590c1cd55aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:34.096412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92799c9-3275-499b-b1e9-e590c1cd55aa service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.096831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92799c9-3275-499b-b1e9-e590c1cd55aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.097175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92799c9-3275-499b-b1e9-e590c1cd55aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.110404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1001/2024] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:34.114411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92799c9-3275-499b-b1e9-e590c1cd55aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:34.116123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92799c9-3275-499b-b1e9-e590c1cd55aa service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:34.116917 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b36a-c553-4ec6-a9d5-0727110b2461 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.117202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b36a-c553-4ec6-a9d5-0727110b2461 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.117475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b36a-c553-4ec6-a9d5-0727110b2461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.128166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1024/2025] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:34.138490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a537b36a-c553-4ec6-a9d5-0727110b2461 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:34.139756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a537b36a-c553-4ec6-a9d5-0727110b2461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:34.149624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1002/2026] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:34.154600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92799c9-3275-499b-b1e9-e590c1cd55aa service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:34.168208 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92799c9-3275-499b-b1e9-e590c1cd55aa service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:34.175461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cbaa2-763f-4f14-918d-cd0c1ec01ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:34.177381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cbaa2-763f-4f14-918d-cd0c1ec01ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.179161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cbaa2-763f-4f14-918d-cd0c1ec01ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.179550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cbaa2-763f-4f14-918d-cd0c1ec01ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.183094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cbaa2-763f-4f14-918d-cd0c1ec01ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:34.183542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cbaa2-763f-4f14-918d-cd0c1ec01ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:34.185276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cbaa2-763f-4f14-918d-cd0c1ec01ef5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:34.203917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1025/2027] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:34.205655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b36a-c553-4ec6-a9d5-0727110b2461 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:34.217236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b36a-c553-4ec6-a9d5-0727110b2461 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:34.225736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7748-91cd-44cb-b36f-78428284c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:34.226692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7748-91cd-44cb-b36f-78428284c755 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.227070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7748-91cd-44cb-b36f-78428284c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.227497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7748-91cd-44cb-b36f-78428284c755 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.228283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc7748-91cd-44cb-b36f-78428284c755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:34.230701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc7748-91cd-44cb-b36f-78428284c755 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:34.278198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1003/2028] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:34 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:34.282992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cbaa2-763f-4f14-918d-cd0c1ec01ef5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:34.300836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cbaa2-763f-4f14-918d-cd0c1ec01ef5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:34.420590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61071e-ea04-4c24-8469-62d6f74a0cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:34.421919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61071e-ea04-4c24-8469-62d6f74a0cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.422320 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61071e-ea04-4c24-8469-62d6f74a0cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.422718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61071e-ea04-4c24-8469-62d6f74a0cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.423512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61071e-ea04-4c24-8469-62d6f74a0cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:34.426580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61071e-ea04-4c24-8469-62d6f74a0cd2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:34.469285 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1026/2029] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:34 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:34.470795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7748-91cd-44cb-b36f-78428284c755 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:34.502461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7748-91cd-44cb-b36f-78428284c755 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:34.509738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a8cf-3284-477b-87df-df5bbdb2e7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:34.510754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a8cf-3284-477b-87df-df5bbdb2e7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.511415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a8cf-3284-477b-87df-df5bbdb2e7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.512063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a8cf-3284-477b-87df-df5bbdb2e7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.513440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148a8cf-3284-477b-87df-df5bbdb2e7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:34.516588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148a8cf-3284-477b-87df-df5bbdb2e7f6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:34.530567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61071e-ea04-4c24-8469-62d6f74a0cd2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:34.533107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9b61071e-ea04-4c24-8469-62d6f74a0cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:34.538942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:34.556215 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1004/2030] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:34.558710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a8cf-3284-477b-87df-df5bbdb2e7f6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:34.568832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61071e-ea04-4c24-8469-62d6f74a0cd2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:34.571663 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a8cf-3284-477b-87df-df5bbdb2e7f6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:34.576299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:34.577434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.578729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.579328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] PATH_INFO: `/v3/projects/1c3031c3a7da42adabcab66e9e64d0ff` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.581120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3031c3a7da42adabcab66e9e64d0ff)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:34.583706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:34.584898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63933995-4a70-4f53-9460-14d78d68b03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:34.585650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63933995-4a70-4f53-9460-14d78d68b03a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.586146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63933995-4a70-4f53-9460-14d78d68b03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.586270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63933995-4a70-4f53-9460-14d78d68b03a admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.586833 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63933995-4a70-4f53-9460-14d78d68b03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:34.588575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63933995-4a70-4f53-9460-14d78d68b03a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:34.604070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1005/2031] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:34.608720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63933995-4a70-4f53-9460-14d78d68b03a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:34.621762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63933995-4a70-4f53-9460-14d78d68b03a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:34.627430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e828dd-61e3-4224-81a7-10d6200050f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:34.628388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e828dd-61e3-4224-81a7-10d6200050f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.629243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e828dd-61e3-4224-81a7-10d6200050f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.629243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e828dd-61e3-4224-81a7-10d6200050f1 admin admin] PATH_INFO: `/v3/projects/5061c6e544d346c1a78ea3195ced0cda/users/b869d8ef93fd41018d9de22742b8f6c0/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.682233 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3031c3a7da42adabcab66e9e64d0ff', 'request_id': 'req-c1c285a8-f486-46be-a8a2-2110b056f94b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:34.683571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e828dd-61e3-4224-81a7-10d6200050f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5061c6e544d346c1a78ea3195ced0cda, user_id=b869d8ef93fd41018d9de22742b8f6c0, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:34.688208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e828dd-61e3-4224-81a7-10d6200050f1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:34.699605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3031c3a7da42adabcab66e9e64d0ff', 'request_id': 'req-c1c285a8-f486-46be-a8a2-2110b056f94b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:34.725852 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3031c3a7da42adabcab66e9e64d0ff', 'request_id': 'req-c1c285a8-f486-46be-a8a2-2110b056f94b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:34.741075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1006/2032] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:34 2022] PUT /identity/v3/projects/5061c6e544d346c1a78ea3195ced0cda/users/b869d8ef93fd41018d9de22742b8f6c0/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:34.744852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e51d6-2b79-47f7-9140-0d5d58ca214a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.745952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e51d6-2b79-47f7-9140-0d5d58ca214a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.747043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e51d6-2b79-47f7-9140-0d5d58ca214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.759011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] The token cache is being invalidate because project 1c3031c3a7da42adabcab66e9e64d0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:34.759602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:34.760654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:34.763327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1027/2033] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:34 2022] DELETE /identity/v3/projects/1c3031c3a7da42adabcab66e9e64d0ff => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:34.766857 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:34.768454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:34.783880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ce8e51d6-2b79-47f7-9140-0d5d58ca214a None None] MFA Rules not processed for user `b869d8ef93fd41018d9de22742b8f6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:34.785555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ce8e51d6-2b79-47f7-9140-0d5d58ca214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:34.822102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:34.857893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c285a8-f486-46be-a8a2-2110b056f94b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:34.895742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1007/2034] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:34.898662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e51d6-2b79-47f7-9140-0d5d58ca214a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:34.901811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ce8e51d6-2b79-47f7-9140-0d5d58ca214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:34.970397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:34.971123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:34.971515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:34.971991 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] PATH_INFO: `/v3/users/8520bba995a644b29c6fcb89c10d833a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:34.973201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8520bba995a644b29c6fcb89c10d833a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:34.975216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:34.996514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e51d6-2b79-47f7-9140-0d5d58ca214a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:35.001676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20918ae6-9cd4-4a38-b21b-82a5f08a4ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:35.002360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918ae6-9cd4-4a38-b21b-82a5f08a4ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.002635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918ae6-9cd4-4a38-b21b-82a5f08a4ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.002923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918ae6-9cd4-4a38-b21b-82a5f08a4ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.003591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20918ae6-9cd4-4a38-b21b-82a5f08a4ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:35.005506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20918ae6-9cd4-4a38-b21b-82a5f08a4ac5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:35.026650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8520bba995a644b29c6fcb89c10d833a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.035482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8520bba995a644b29c6fcb89c10d833a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.049842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1008/2035] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:34 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:35.050986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20918ae6-9cd4-4a38-b21b-82a5f08a4ac5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:35.054472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-20918ae6-9cd4-4a38-b21b-82a5f08a4ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:35.058334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8520bba995a644b29c6fcb89c10d833a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.059063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8520bba995a644b29c6fcb89c10d833a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.065958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8520bba995a644b29c6fcb89c10d833a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.071831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1028/2036] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:34 2022] DELETE /identity/v3/users/8520bba995a644b29c6fcb89c10d833a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:35.074972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:35.075189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:35.116609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:35.145993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20918ae6-9cd4-4a38-b21b-82a5f08a4ac5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:35.190127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd61120-1478-4e5d-8cfd-788fb1470221 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:35.211225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00750413-7051-4197-834b-79eaef2f8721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:35.212424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750413-7051-4197-834b-79eaef2f8721 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.213017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750413-7051-4197-834b-79eaef2f8721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.213647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750413-7051-4197-834b-79eaef2f8721 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.218020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00750413-7051-4197-834b-79eaef2f8721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:35.220991 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00750413-7051-4197-834b-79eaef2f8721 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:35.227992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:35.228662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.228940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.229216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] PATH_INFO: `/v3/projects/845667c2521d4cd88c644c0ad90d97ea` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.230429 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] RBAC: Authorizing `identity:delete_project(project_id=845667c2521d4cd88c644c0ad90d97ea)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:35.232457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:35.235233 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:35.262566 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1029/2037] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:35 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:35.264976 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00750413-7051-4197-834b-79eaef2f8721 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:35.301164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00750413-7051-4197-834b-79eaef2f8721 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:35.311223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012e156-80da-448a-b0f3-213d45a025c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:35.322949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845667c2521d4cd88c644c0ad90d97ea', 'request_id': 'req-20b999f8-29fe-45c6-b880-db056f47718e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.326977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012e156-80da-448a-b0f3-213d45a025c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.330319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012e156-80da-448a-b0f3-213d45a025c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.330319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012e156-80da-448a-b0f3-213d45a025c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.330319 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012e156-80da-448a-b0f3-213d45a025c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:35.332522 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845667c2521d4cd88c644c0ad90d97ea', 'request_id': 'req-20b999f8-29fe-45c6-b880-db056f47718e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.335541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012e156-80da-448a-b0f3-213d45a025c5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:35.342178 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845667c2521d4cd88c644c0ad90d97ea', 'request_id': 'req-20b999f8-29fe-45c6-b880-db056f47718e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.359438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1030/2038] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:35.360367 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012e156-80da-448a-b0f3-213d45a025c5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:35.361233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] The token cache is being invalidate because project 845667c2521d4cd88c644c0ad90d97ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:35.361629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.362959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.367349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1009/2039] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:35 2022] DELETE /identity/v3/projects/845667c2521d4cd88c644c0ad90d97ea => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:35.370678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:35.375750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:35.376833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012e156-80da-448a-b0f3-213d45a025c5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:35.451798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe1110-14ad-4e88-a0df-f096ad7e2c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:35.452898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe1110-14ad-4e88-a0df-f096ad7e2c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.453885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe1110-14ad-4e88-a0df-f096ad7e2c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.454181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe1110-14ad-4e88-a0df-f096ad7e2c37 admin admin] PATH_INFO: `/v3/projects/75d18133771c4673a20ed137cf853890/users/d1b56db958fc48898463cbe2a81aa64f/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.471023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b999f8-29fe-45c6-b880-db056f47718e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:35.478088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:35.479358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.479659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.479943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] PATH_INFO: `/v3/users/04d0b20abff34315a4044dfbbedde410` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.481570 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d0b20abff34315a4044dfbbedde410)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:35.483869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:35.485257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe1110-14ad-4e88-a0df-f096ad7e2c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d18133771c4673a20ed137cf853890, user_id=d1b56db958fc48898463cbe2a81aa64f, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:35.489146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe1110-14ad-4e88-a0df-f096ad7e2c37 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:35.505736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1031/2040] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:35 2022] PUT /identity/v3/projects/75d18133771c4673a20ed137cf853890/users/d1b56db958fc48898463cbe2a81aa64f/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:35.506561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe1110-14ad-4e88-a0df-f096ad7e2c37 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:35.508450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f5fe1110-14ad-4e88-a0df-f096ad7e2c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:35.523873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:35.571352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d0b20abff34315a4044dfbbedde410'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.572290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d0b20abff34315a4044dfbbedde410'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.582049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d0b20abff34315a4044dfbbedde410'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.597075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe1110-14ad-4e88-a0df-f096ad7e2c37 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:35.598066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d0b20abff34315a4044dfbbedde410'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.605369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:35.606263 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.606521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d0b20abff34315a4044dfbbedde410'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.606642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.606751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] PATH_INFO: `/v3/projects/1940fbfebefc421da90898311d4afc34` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.607997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1940fbfebefc421da90898311d4afc34)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:35.610485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:35.621446 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1010/2041] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:35 2022] DELETE /identity/v3/users/04d0b20abff34315a4044dfbbedde410 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:35.623299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:35.627748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:35.678331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1940fbfebefc421da90898311d4afc34', 'request_id': 'req-80948eb4-e57c-417f-8cdd-e6bc406e44fe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.690278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1940fbfebefc421da90898311d4afc34', 'request_id': 'req-80948eb4-e57c-417f-8cdd-e6bc406e44fe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.711899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1940fbfebefc421da90898311d4afc34', 'request_id': 'req-80948eb4-e57c-417f-8cdd-e6bc406e44fe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.715469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:35.726787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5354c0c-9749-4d5d-9bce-92cb35d5b9f2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:35.728968 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] The token cache is being invalidate because project 1940fbfebefc421da90898311d4afc34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:35.729262 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.730133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-80948eb4-e57c-417f-8cdd-e6bc406e44fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:35.732907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1032/2042] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:35 2022] DELETE /identity/v3/projects/1940fbfebefc421da90898311d4afc34 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:35.737926 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ec382-dcee-4b9d-a3ca-58f96a1379a6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.738766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ec382-dcee-4b9d-a3ca-58f96a1379a6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.739143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ec382-dcee-4b9d-a3ca-58f96a1379a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.764252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1e2ec382-dcee-4b9d-a3ca-58f96a1379a6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:35.765561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1e2ec382-dcee-4b9d-a3ca-58f96a1379a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:35.802603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079bc6f-b44b-44c0-b27b-3d7893db255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:35.803475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079bc6f-b44b-44c0-b27b-3d7893db255d admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.803694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079bc6f-b44b-44c0-b27b-3d7893db255d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.803970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079bc6f-b44b-44c0-b27b-3d7893db255d admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.805256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079bc6f-b44b-44c0-b27b-3d7893db255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:35.808173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079bc6f-b44b-44c0-b27b-3d7893db255d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:35.822845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1011/2043] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:35.827742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079bc6f-b44b-44c0-b27b-3d7893db255d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:35.829480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5079bc6f-b44b-44c0-b27b-3d7893db255d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:35.842550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079bc6f-b44b-44c0-b27b-3d7893db255d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:35.844383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1033/2044] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:35.847830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdb581-a416-4d8c-9aea-67c0b1e1ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:35.848713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb581-a416-4d8c-9aea-67c0b1e1ee3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.848908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb581-a416-4d8c-9aea-67c0b1e1ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.849376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb581-a416-4d8c-9aea-67c0b1e1ee3c admin admin] PATH_INFO: `/v3/projects/75d18133771c4673a20ed137cf853890/users/d1b56db958fc48898463cbe2a81aa64f/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.851487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdb581-a416-4d8c-9aea-67c0b1e1ee3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d18133771c4673a20ed137cf853890, user_id=d1b56db958fc48898463cbe2a81aa64f, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:35.852171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d260a-01b9-4b34-8fc7-2c5bd0988a0b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.852456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d260a-01b9-4b34-8fc7-2c5bd0988a0b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.852732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d260a-01b9-4b34-8fc7-2c5bd0988a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.854537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdb581-a416-4d8c-9aea-67c0b1e1ee3c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:35.875786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1012/2045] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:35 2022] PUT /identity/v3/projects/75d18133771c4673a20ed137cf853890/users/d1b56db958fc48898463cbe2a81aa64f/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:35.877973 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729ea2b-8f0b-44f0-87f1-6dc3ebf23e41 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:35.878309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729ea2b-8f0b-44f0-87f1-6dc3ebf23e41 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:35.878606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3f8d260a-01b9-4b34-8fc7-2c5bd0988a0b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:35.878725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729ea2b-8f0b-44f0-87f1-6dc3ebf23e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:35.880001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3f8d260a-01b9-4b34-8fc7-2c5bd0988a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:35.941966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5729ea2b-8f0b-44f0-87f1-6dc3ebf23e41 None None] MFA Rules not processed for user `d1b56db958fc48898463cbe2a81aa64f`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:35.944235 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5729ea2b-8f0b-44f0-87f1-6dc3ebf23e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:35.988768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:36.024259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1034/2046] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:36.028554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d260a-01b9-4b34-8fc7-2c5bd0988a0b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:36.039073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d260a-01b9-4b34-8fc7-2c5bd0988a0b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:36.046747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65da61-5e96-4d1e-ada2-5afe0c5a3255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:36.047529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65da61-5e96-4d1e-ada2-5afe0c5a3255 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.048051 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65da61-5e96-4d1e-ada2-5afe0c5a3255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.048508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65da61-5e96-4d1e-ada2-5afe0c5a3255 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.049298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65da61-5e96-4d1e-ada2-5afe0c5a3255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:36.049689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65da61-5e96-4d1e-ada2-5afe0c5a3255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:36.051764 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65da61-5e96-4d1e-ada2-5afe0c5a3255 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:36.068453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1035/2047] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:36.069456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65da61-5e96-4d1e-ada2-5afe0c5a3255 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:36.071559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7a65da61-5e96-4d1e-ada2-5afe0c5a3255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:36.090393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65da61-5e96-4d1e-ada2-5afe0c5a3255 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:36.092100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1013/2048] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:36.097323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729ea2b-8f0b-44f0-87f1-6dc3ebf23e41 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:36.105528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:36.106287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.106632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.106970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] PATH_INFO: `/v3/projects/91632454b0ad42549229994117be4efa` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.108381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=91632454b0ad42549229994117be4efa)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:36.108914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729ea2b-8f0b-44f0-87f1-6dc3ebf23e41 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:36.110438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:36.115602 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28efe1-9881-48e5-a6bd-1a542b433190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:36.116403 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28efe1-9881-48e5-a6bd-1a542b433190 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.116752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28efe1-9881-48e5-a6bd-1a542b433190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.117127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28efe1-9881-48e5-a6bd-1a542b433190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.117934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28efe1-9881-48e5-a6bd-1a542b433190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:36.124690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28efe1-9881-48e5-a6bd-1a542b433190 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:36.211460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91632454b0ad42549229994117be4efa', 'request_id': 'req-37e6a2b6-8163-4c77-9ac1-feadec726bbe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:36.211825 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1014/2049] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:36 2022] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:36.215369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28efe1-9881-48e5-a6bd-1a542b433190 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:36.221200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6d28efe1-9881-48e5-a6bd-1a542b433190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:36.225659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91632454b0ad42549229994117be4efa', 'request_id': 'req-37e6a2b6-8163-4c77-9ac1-feadec726bbe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:36.247552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91632454b0ad42549229994117be4efa', 'request_id': 'req-37e6a2b6-8163-4c77-9ac1-feadec726bbe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:36.271100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] The token cache is being invalidate because project 91632454b0ad42549229994117be4efa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:36.271404 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:36.272082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:36.273919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1036/2050] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:36 2022] DELETE /identity/v3/projects/91632454b0ad42549229994117be4efa => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:36.274435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:36.280236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:36.288854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:36.318364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28efe1-9881-48e5-a6bd-1a542b433190 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:36.323933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8aaea-b12f-4d42-96e2-c8c038758518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:36.324627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8aaea-b12f-4d42-96e2-c8c038758518 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.325066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8aaea-b12f-4d42-96e2-c8c038758518 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.325349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8aaea-b12f-4d42-96e2-c8c038758518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.327258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-02f8aaea-b12f-4d42-96e2-c8c038758518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:36.382205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6a2b6-8163-4c77-9ac1-feadec726bbe admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:36.428270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8aaea-b12f-4d42-96e2-c8c038758518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:36.430090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8aaea-b12f-4d42-96e2-c8c038758518 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:36.446025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1015/2051] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:36.455100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8aaea-b12f-4d42-96e2-c8c038758518 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:36.462148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-02f8aaea-b12f-4d42-96e2-c8c038758518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:36.481796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f1abf-1ee0-43cd-b729-7ecfd61549f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:36.482833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f1abf-1ee0-43cd-b729-7ecfd61549f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.483116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f1abf-1ee0-43cd-b729-7ecfd61549f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.483488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f1abf-1ee0-43cd-b729-7ecfd61549f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.484139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f1abf-1ee0-43cd-b729-7ecfd61549f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:36.486068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f1abf-1ee0-43cd-b729-7ecfd61549f2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:36.517596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1037/2052] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:36 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:36.522794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f1abf-1ee0-43cd-b729-7ecfd61549f2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:36.524119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:36.535796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f1abf-1ee0-43cd-b729-7ecfd61549f2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:36.541589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88f1ed-0dca-4d22-9b75-a1fcc20cc985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:36.542219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88f1ed-0dca-4d22-9b75-a1fcc20cc985 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.542500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88f1ed-0dca-4d22-9b75-a1fcc20cc985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.542775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88f1ed-0dca-4d22-9b75-a1fcc20cc985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.543471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88f1ed-0dca-4d22-9b75-a1fcc20cc985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:36.545173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88f1ed-0dca-4d22-9b75-a1fcc20cc985 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:36.551066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8aaea-b12f-4d42-96e2-c8c038758518 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:36.557216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1038/2053] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:36.559965 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:36.560768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.561113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.561445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] PATH_INFO: `/v3/users/426688a90a324ca9bdb55422d18b47c7` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.562231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88f1ed-0dca-4d22-9b75-a1fcc20cc985 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:36.563090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=426688a90a324ca9bdb55422d18b47c7)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:36.565558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:36.580446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88f1ed-0dca-4d22-9b75-a1fcc20cc985 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:36.586767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f72bc-57cb-412f-96ea-4d07c7abb79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:36.587163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f72bc-57cb-412f-96ea-4d07c7abb79f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.587475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f72bc-57cb-412f-96ea-4d07c7abb79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.587746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f72bc-57cb-412f-96ea-4d07c7abb79f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.588567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f72bc-57cb-412f-96ea-4d07c7abb79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:36.590170 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f72bc-57cb-412f-96ea-4d07c7abb79f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:36.603127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1039/2054] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:36.608946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f72bc-57cb-412f-96ea-4d07c7abb79f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:36.627351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f72bc-57cb-412f-96ea-4d07c7abb79f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:36.635063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426688a90a324ca9bdb55422d18b47c7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:36.636030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426688a90a324ca9bdb55422d18b47c7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:36.636467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15ca00-0aef-4411-a4e8-3ee3c13ef350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:36.637431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ca00-0aef-4411-a4e8-3ee3c13ef350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.637431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ca00-0aef-4411-a4e8-3ee3c13ef350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.637743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ca00-0aef-4411-a4e8-3ee3c13ef350 admin admin] PATH_INFO: `/v3/projects/b05157223aab470eb516427fc818f080/users/b3b3cb35d60943f2b84f0f1a99f0d72a/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.645190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426688a90a324ca9bdb55422d18b47c7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:36.661767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15ca00-0aef-4411-a4e8-3ee3c13ef350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05157223aab470eb516427fc818f080, user_id=b3b3cb35d60943f2b84f0f1a99f0d72a, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:36.663109 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15ca00-0aef-4411-a4e8-3ee3c13ef350 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:36.675528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426688a90a324ca9bdb55422d18b47c7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:36.683147 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1040/2055] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:36 2022] PUT /identity/v3/projects/b05157223aab470eb516427fc818f080/users/b3b3cb35d60943f2b84f0f1a99f0d72a/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:36.684143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426688a90a324ca9bdb55422d18b47c7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:36.694661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c416-1d9f-42fb-a549-3260f3b6da10 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.695187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c416-1d9f-42fb-a549-3260f3b6da10 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.698523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1016/2056] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:36 2022] DELETE /identity/v3/users/426688a90a324ca9bdb55422d18b47c7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:36.698886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c416-1d9f-42fb-a549-3260f3b6da10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.736355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ada4c416-1d9f-42fb-a549-3260f3b6da10 None None] MFA Rules not processed for user `b3b3cb35d60943f2b84f0f1a99f0d72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:36.737698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ada4c416-1d9f-42fb-a549-3260f3b6da10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:36.824065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:36.884478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1041/2057] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:36.897193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:36.898859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:36.978339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dcb2b-2947-458d-bf91-dd893c20aeb5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:36.984443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91556a-3f90-4d2f-b33f-9cb271c03140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:36.985080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91556a-3f90-4d2f-b33f-9cb271c03140 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:36.985356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91556a-3f90-4d2f-b33f-9cb271c03140 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:36.985640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91556a-3f90-4d2f-b33f-9cb271c03140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:36.997738 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91556a-3f90-4d2f-b33f-9cb271c03140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:36.999265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91556a-3f90-4d2f-b33f-9cb271c03140 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:37.022283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1017/2058] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:37.175168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4c416-1d9f-42fb-a549-3260f3b6da10 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:37.177253 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ada4c416-1d9f-42fb-a549-3260f3b6da10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:37.290567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4c416-1d9f-42fb-a549-3260f3b6da10 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:37.299007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:37.299910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:37.300258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:37.300586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] PATH_INFO: `/v3/projects/df82455e62df41ecb504d078de9af67d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:37.302146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df82455e62df41ecb504d078de9af67d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:37.309469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:37.376475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df82455e62df41ecb504d078de9af67d', 'request_id': 'req-02be6cfa-0b59-4d9e-967b-eada8344e873'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:37.387116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df82455e62df41ecb504d078de9af67d', 'request_id': 'req-02be6cfa-0b59-4d9e-967b-eada8344e873'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:37.399518 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df82455e62df41ecb504d078de9af67d', 'request_id': 'req-02be6cfa-0b59-4d9e-967b-eada8344e873'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:37.431166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] The token cache is being invalidate because project df82455e62df41ecb504d078de9af67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:37.431930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:37.433119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-02be6cfa-0b59-4d9e-967b-eada8344e873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:37.435973 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1042/2059] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:37 2022] DELETE /identity/v3/projects/df82455e62df41ecb504d078de9af67d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:37.441776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f3cdc-a172-4b07-8109-0dc86c7ecaa9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:37.442201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f3cdc-a172-4b07-8109-0dc86c7ecaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:37.442935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f3cdc-a172-4b07-8109-0dc86c7ecaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:37.476266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f21f3cdc-a172-4b07-8109-0dc86c7ecaa9 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:37.491343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f21f3cdc-a172-4b07-8109-0dc86c7ecaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:37.593431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1018/2060] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:37.601989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c6ef-78b0-4579-adae-0cb974ee45c5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:37.602282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c6ef-78b0-4579-adae-0cb974ee45c5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:37.602531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c6ef-78b0-4579-adae-0cb974ee45c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:37.632050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2eb6c6ef-78b0-4579-adae-0cb974ee45c5 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:37.633265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2eb6c6ef-78b0-4579-adae-0cb974ee45c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:37.642077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1043/2061] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:37.646572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f3cdc-a172-4b07-8109-0dc86c7ecaa9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:37.657603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f3cdc-a172-4b07-8109-0dc86c7ecaa9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:37.663242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19459823-5211-4df3-97a4-6fc60c46dacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:37.663911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19459823-5211-4df3-97a4-6fc60c46dacf admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:37.664189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19459823-5211-4df3-97a4-6fc60c46dacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:37.664458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19459823-5211-4df3-97a4-6fc60c46dacf admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:37.665108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19459823-5211-4df3-97a4-6fc60c46dacf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:37.665532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19459823-5211-4df3-97a4-6fc60c46dacf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:37.667854 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19459823-5211-4df3-97a4-6fc60c46dacf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:37.669816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:37.686398 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1019/2062] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:37.687554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6c6ef-78b0-4579-adae-0cb974ee45c5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:37.696912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6c6ef-78b0-4579-adae-0cb974ee45c5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:37.701972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c29747-f363-49c3-8f8c-876ca9f820dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:37.702600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c29747-f363-49c3-8f8c-876ca9f820dc admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:37.702876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c29747-f363-49c3-8f8c-876ca9f820dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:37.703132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c29747-f363-49c3-8f8c-876ca9f820dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:37.704096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c29747-f363-49c3-8f8c-876ca9f820dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:37.705905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c29747-f363-49c3-8f8c-876ca9f820dc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:37.740063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1044/2063] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:37 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:37.745960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19459823-5211-4df3-97a4-6fc60c46dacf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:37.760140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19459823-5211-4df3-97a4-6fc60c46dacf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:37.822255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f6155-4e38-483d-8d02-be1625586b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:37.822953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f6155-4e38-483d-8d02-be1625586b12 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:37.823260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f6155-4e38-483d-8d02-be1625586b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:37.823644 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f6155-4e38-483d-8d02-be1625586b12 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:37.824287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f6155-4e38-483d-8d02-be1625586b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:37.826190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f6155-4e38-483d-8d02-be1625586b12 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:37.850640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1020/2064] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:37 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:37.855620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c29747-f363-49c3-8f8c-876ca9f820dc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:37.866985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c29747-f363-49c3-8f8c-876ca9f820dc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:37.872649 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93b251-ebd2-490b-8769-6d9eba128811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:37.873610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93b251-ebd2-490b-8769-6d9eba128811 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:37.873972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93b251-ebd2-490b-8769-6d9eba128811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:37.874303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93b251-ebd2-490b-8769-6d9eba128811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:37.875025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93b251-ebd2-490b-8769-6d9eba128811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:37.876797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93b251-ebd2-490b-8769-6d9eba128811 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:37.892091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1045/2065] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:37.893988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f6155-4e38-483d-8d02-be1625586b12 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:37.904489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f6155-4e38-483d-8d02-be1625586b12 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:37.910407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d4cb3-100e-46ee-9c4a-a0412923b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:37.911059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4cb3-100e-46ee-9c4a-a0412923b0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:37.911355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4cb3-100e-46ee-9c4a-a0412923b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:37.911688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4cb3-100e-46ee-9c4a-a0412923b0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:37.912352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d4cb3-100e-46ee-9c4a-a0412923b0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:37.913982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d4cb3-100e-46ee-9c4a-a0412923b0f8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:37.927543 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1021/2066] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:37.930331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93b251-ebd2-490b-8769-6d9eba128811 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:37.940885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93b251-ebd2-490b-8769-6d9eba128811 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:37.945532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78c344-88a9-4df6-a9dd-fa28e2e19400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:37.946196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78c344-88a9-4df6-a9dd-fa28e2e19400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:37.946471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78c344-88a9-4df6-a9dd-fa28e2e19400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:37.946763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78c344-88a9-4df6-a9dd-fa28e2e19400 admin admin] PATH_INFO: `/v3/projects/c952f6e7ace24e15a0d1db8bbbd95044/users/38ad994421e24faa85d84691b53a6b5c/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:37.962276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78c344-88a9-4df6-a9dd-fa28e2e19400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c952f6e7ace24e15a0d1db8bbbd95044, user_id=38ad994421e24faa85d84691b53a6b5c, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:37.965033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78c344-88a9-4df6-a9dd-fa28e2e19400 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:37.978564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1046/2067] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:37 2022] PUT /identity/v3/projects/c952f6e7ace24e15a0d1db8bbbd95044/users/38ad994421e24faa85d84691b53a6b5c/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:37.983889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c136b12-6e7b-45fe-b160-eff860efe2db None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:37.984167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c136b12-6e7b-45fe-b160-eff860efe2db None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:37.984438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c136b12-6e7b-45fe-b160-eff860efe2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:38.004565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8c136b12-6e7b-45fe-b160-eff860efe2db None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:38.005853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8c136b12-6e7b-45fe-b160-eff860efe2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:38.072214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1022/2068] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:38.082101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78c344-88a9-4df6-a9dd-fa28e2e19400 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:38.084117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ee78c344-88a9-4df6-a9dd-fa28e2e19400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:38.101802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:38.158076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78c344-88a9-4df6-a9dd-fa28e2e19400 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:38.161795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e201cc-f6a4-4987-8cb6-9e58bbea3a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:38.162420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e201cc-f6a4-4987-8cb6-9e58bbea3a33 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:38.162694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e201cc-f6a4-4987-8cb6-9e58bbea3a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:38.162964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e201cc-f6a4-4987-8cb6-9e58bbea3a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:38.172298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e201cc-f6a4-4987-8cb6-9e58bbea3a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:38.173728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e201cc-f6a4-4987-8cb6-9e58bbea3a33 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:38.183335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1047/2069] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:39.021440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c136b12-6e7b-45fe-b160-eff860efe2db None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:39.023586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8c136b12-6e7b-45fe-b160-eff860efe2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:39.089358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c136b12-6e7b-45fe-b160-eff860efe2db None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:39.093351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a416ed-7e1e-4962-bdfd-d60a95f60e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:39.094105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a416ed-7e1e-4962-bdfd-d60a95f60e8f service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:39.094385 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a416ed-7e1e-4962-bdfd-d60a95f60e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:39.094654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a416ed-7e1e-4962-bdfd-d60a95f60e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:39.096484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-60a416ed-7e1e-4962-bdfd-d60a95f60e8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:39.131512 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:39.176432 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a416ed-7e1e-4962-bdfd-d60a95f60e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:39.177999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a416ed-7e1e-4962-bdfd-d60a95f60e8f service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:39.189064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1023/2070] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:39.541576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0dda3-1e5c-481c-aab3-9affbdb0ab8e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:39.542535 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0dda3-1e5c-481c-aab3-9affbdb0ab8e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:39.543188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0dda3-1e5c-481c-aab3-9affbdb0ab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:39.607646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-80c0dda3-1e5c-481c-aab3-9affbdb0ab8e None None] MFA Rules not processed for user `38ad994421e24faa85d84691b53a6b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:39.609313 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-80c0dda3-1e5c-481c-aab3-9affbdb0ab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:39.763379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1048/2071] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:39.778566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a416ed-7e1e-4962-bdfd-d60a95f60e8f service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:39.794351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a416ed-7e1e-4962-bdfd-d60a95f60e8f service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:39.803866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725773c-0e0c-4bda-83a6-fe311df52eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:39.805332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725773c-0e0c-4bda-83a6-fe311df52eaf service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:39.806448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725773c-0e0c-4bda-83a6-fe311df52eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:39.807457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725773c-0e0c-4bda-83a6-fe311df52eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:39.821878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725773c-0e0c-4bda-83a6-fe311df52eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:39.824640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725773c-0e0c-4bda-83a6-fe311df52eaf service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:39.839679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1024/2072] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:42.385450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051f8e-65fc-46df-bfb0-32c385f37e38 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:42.385977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051f8e-65fc-46df-bfb0-32c385f37e38 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:42.385977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051f8e-65fc-46df-bfb0-32c385f37e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:42.405237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b7051f8e-65fc-46df-bfb0-32c385f37e38 None None] MFA Rules not processed for user `38ad994421e24faa85d84691b53a6b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:42.406464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b7051f8e-65fc-46df-bfb0-32c385f37e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:42.418876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1049/2073] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:43.520559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725773c-0e0c-4bda-83a6-fe311df52eaf service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:43.523056 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6725773c-0e0c-4bda-83a6-fe311df52eaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:43.538144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725773c-0e0c-4bda-83a6-fe311df52eaf service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:43.543690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:43.544446 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:43.544724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:43.544988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] PATH_INFO: `/v3/users/b3b3cb35d60943f2b84f0f1a99f0d72a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:43.546108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b3cb35d60943f2b84f0f1a99f0d72a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:43.548047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:43.608631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b3cb35d60943f2b84f0f1a99f0d72a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:43.609219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b3cb35d60943f2b84f0f1a99f0d72a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:43.618790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b3cb35d60943f2b84f0f1a99f0d72a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:43.633594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b3cb35d60943f2b84f0f1a99f0d72a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:43.641886 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b3cb35d60943f2b84f0f1a99f0d72a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:43.651392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1025/2074] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:43 2022] DELETE /identity/v3/users/b3b3cb35d60943f2b84f0f1a99f0d72a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:43.653457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32bd91-52e5-4cb0-a922-b4f1dc2438fc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:43.653928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32bd91-52e5-4cb0-a922-b4f1dc2438fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:43.654263 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32bd91-52e5-4cb0-a922-b4f1dc2438fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:43.677247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fe32bd91-52e5-4cb0-a922-b4f1dc2438fc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:43.678451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fe32bd91-52e5-4cb0-a922-b4f1dc2438fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:43.777791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1050/2075] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:43.785220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:43.787298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:43.892409 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24283-b514-4da4-8705-d1274202b2af admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:43.896516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d741a1-bbc8-414a-b4c9-6cead1b90a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:43.897815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d741a1-bbc8-414a-b4c9-6cead1b90a69 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:43.897815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d741a1-bbc8-414a-b4c9-6cead1b90a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:43.897815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d741a1-bbc8-414a-b4c9-6cead1b90a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:43.910969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d741a1-bbc8-414a-b4c9-6cead1b90a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:43.912584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d741a1-bbc8-414a-b4c9-6cead1b90a69 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:43.923971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1026/2076] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:44.181868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32bd91-52e5-4cb0-a922-b4f1dc2438fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:44.184952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fe32bd91-52e5-4cb0-a922-b4f1dc2438fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:44.209231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32bd91-52e5-4cb0-a922-b4f1dc2438fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:44.218564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:44.219505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:44.219923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:44.220287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] PATH_INFO: `/v3/users/b869d8ef93fd41018d9de22742b8f6c0` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:44.221898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b869d8ef93fd41018d9de22742b8f6c0)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:44.224096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:44.269878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:44.292175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b869d8ef93fd41018d9de22742b8f6c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:44.299826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d741a1-bbc8-414a-b4c9-6cead1b90a69 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:44.301389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b1d741a1-bbc8-414a-b4c9-6cead1b90a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:44.305277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b869d8ef93fd41018d9de22742b8f6c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:44.329489 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b869d8ef93fd41018d9de22742b8f6c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:44.330033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b869d8ef93fd41018d9de22742b8f6c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:44.339818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-aff98950-33e3-4c91-881d-d8d0b0dacc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b869d8ef93fd41018d9de22742b8f6c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:44.349153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1051/2077] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:44 2022] DELETE /identity/v3/users/b869d8ef93fd41018d9de22742b8f6c0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:44.350361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d741a1-bbc8-414a-b4c9-6cead1b90a69 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:44.350747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c57665-22a8-4bbe-a5ea-dbb2b1a8576b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:44.351121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c57665-22a8-4bbe-a5ea-dbb2b1a8576b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:44.351639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c57665-22a8-4bbe-a5ea-dbb2b1a8576b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:44.376567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e6c57665-22a8-4bbe-a5ea-dbb2b1a8576b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:44.378428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e6c57665-22a8-4bbe-a5ea-dbb2b1a8576b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:44.381271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:44.433332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:44.433976 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:44.434245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:44.434509 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] PATH_INFO: `/v3/projects/b05157223aab470eb516427fc818f080` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:44.435907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05157223aab470eb516427fc818f080)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:44.438609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:44.449589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1052/2078] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:44.458929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c57665-22a8-4bbe-a5ea-dbb2b1a8576b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:44.460455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e6c57665-22a8-4bbe-a5ea-dbb2b1a8576b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:44.497282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05157223aab470eb516427fc818f080', 'request_id': 'req-4ca81cea-18f9-4d03-96d5-7cb54bd97381'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:44.510316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05157223aab470eb516427fc818f080', 'request_id': 'req-4ca81cea-18f9-4d03-96d5-7cb54bd97381'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:44.517082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05157223aab470eb516427fc818f080', 'request_id': 'req-4ca81cea-18f9-4d03-96d5-7cb54bd97381'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:44.532090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] The token cache is being invalidate because project b05157223aab470eb516427fc818f080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:44.532760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c57665-22a8-4bbe-a5ea-dbb2b1a8576b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:44.532847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:44.533187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:44.534861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1027/2079] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:44 2022] DELETE /identity/v3/projects/b05157223aab470eb516427fc818f080 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:44.614203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124b8d0-8efb-498e-8277-8d52f4eed11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:44.614203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b8d0-8efb-498e-8277-8d52f4eed11f service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:44.614690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b8d0-8efb-498e-8277-8d52f4eed11f service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:44.615022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b8d0-8efb-498e-8277-8d52f4eed11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:44.617438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c124b8d0-8efb-498e-8277-8d52f4eed11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:44.661573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:44.756750 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124b8d0-8efb-498e-8277-8d52f4eed11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:44.759519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124b8d0-8efb-498e-8277-8d52f4eed11f service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:44.775872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1053/2080] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:45.176175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:45.177658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:45.191194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca81cea-18f9-4d03-96d5-7cb54bd97381 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:45.196261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:45.196929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:45.200751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:45.206682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] PATH_INFO: `/v3/projects/5061c6e544d346c1a78ea3195ced0cda` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:45.208374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5061c6e544d346c1a78ea3195ced0cda)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:45.210515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:45.277588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5061c6e544d346c1a78ea3195ced0cda', 'request_id': 'req-97b97fb7-a75a-4537-939a-5f4cbd35d314'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:45.299550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5061c6e544d346c1a78ea3195ced0cda', 'request_id': 'req-97b97fb7-a75a-4537-939a-5f4cbd35d314'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:45.316847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5061c6e544d346c1a78ea3195ced0cda', 'request_id': 'req-97b97fb7-a75a-4537-939a-5f4cbd35d314'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:45.339499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] The token cache is being invalidate because project 5061c6e544d346c1a78ea3195ced0cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:45.340188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:45.341041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:45.342881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1028/2081] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:45 2022] DELETE /identity/v3/projects/5061c6e544d346c1a78ea3195ced0cda => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:45.347498 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124b8d0-8efb-498e-8277-8d52f4eed11f service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:45.356937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124b8d0-8efb-498e-8277-8d52f4eed11f service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:45.423399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:45.425503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:45.425503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:45.425503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] PATH_INFO: `/v3/users/d1b56db958fc48898463cbe2a81aa64f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:45.426016 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b56db958fc48898463cbe2a81aa64f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:45.427930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:45.518463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b56db958fc48898463cbe2a81aa64f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:45.531890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b56db958fc48898463cbe2a81aa64f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:45.545861 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b56db958fc48898463cbe2a81aa64f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:45.546583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b56db958fc48898463cbe2a81aa64f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:45.554341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a225b3e5-c0cd-4c43-9c06-11c57d0d74a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b56db958fc48898463cbe2a81aa64f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:45.561659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1054/2082] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:45 2022] DELETE /identity/v3/users/d1b56db958fc48898463cbe2a81aa64f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:45.859381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:45.864059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:45.887901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b97fb7-a75a-4537-939a-5f4cbd35d314 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:45.944554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:45.979690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:45.980346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:45.980603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:45.980867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] PATH_INFO: `/v3/projects/75d18133771c4673a20ed137cf853890` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:45.982801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d18133771c4673a20ed137cf853890)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:45.984760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:46.049100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d18133771c4673a20ed137cf853890', 'request_id': 'req-8aa74066-abbb-41d7-99b3-67b74d621cad'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:46.059833 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d18133771c4673a20ed137cf853890', 'request_id': 'req-8aa74066-abbb-41d7-99b3-67b74d621cad'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:46.068670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d18133771c4673a20ed137cf853890', 'request_id': 'req-8aa74066-abbb-41d7-99b3-67b74d621cad'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:46.088174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] The token cache is being invalidate because project 75d18133771c4673a20ed137cf853890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:46.088461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:46.089128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8aa74066-abbb-41d7-99b3-67b74d621cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:46.091048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1029/2083] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:45 2022] DELETE /identity/v3/projects/75d18133771c4673a20ed137cf853890 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:46.096011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75260a03-32f5-43bd-b00c-8ac2a450ac8c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:46.097448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75260a03-32f5-43bd-b00c-8ac2a450ac8c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:46.097726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75260a03-32f5-43bd-b00c-8ac2a450ac8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:46.118565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-75260a03-32f5-43bd-b00c-8ac2a450ac8c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:46.120154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-75260a03-32f5-43bd-b00c-8ac2a450ac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:46.165068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:46.221730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1055/2084] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:46.224195 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624eaa5-b26f-495d-b521-b564c7d9595b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:46.224484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624eaa5-b26f-495d-b521-b564c7d9595b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:46.224752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624eaa5-b26f-495d-b521-b564c7d9595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:46.249052 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1624eaa5-b26f-495d-b521-b564c7d9595b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:46.250646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1624eaa5-b26f-495d-b521-b564c7d9595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:46.263353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1030/2085] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:46.266346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75260a03-32f5-43bd-b00c-8ac2a450ac8c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:46.280390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75260a03-32f5-43bd-b00c-8ac2a450ac8c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:46.288080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e085bb2-2a30-43eb-be52-25dd1d3ad646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:46.289939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e085bb2-2a30-43eb-be52-25dd1d3ad646 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:46.290374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e085bb2-2a30-43eb-be52-25dd1d3ad646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:46.293763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e085bb2-2a30-43eb-be52-25dd1d3ad646 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:46.295745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e085bb2-2a30-43eb-be52-25dd1d3ad646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:46.296313 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e085bb2-2a30-43eb-be52-25dd1d3ad646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:46.300653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e085bb2-2a30-43eb-be52-25dd1d3ad646 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:46.335940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1056/2086] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:33:46.340064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624eaa5-b26f-495d-b521-b564c7d9595b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:46.351105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624eaa5-b26f-495d-b521-b564c7d9595b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:46.356788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40185a94-77e5-40f3-9dae-61fe73f05436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:46.357669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185a94-77e5-40f3-9dae-61fe73f05436 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:46.358088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185a94-77e5-40f3-9dae-61fe73f05436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:46.358499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185a94-77e5-40f3-9dae-61fe73f05436 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:46.359285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40185a94-77e5-40f3-9dae-61fe73f05436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:46.361584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40185a94-77e5-40f3-9dae-61fe73f05436 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:46.402242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1031/2087] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:46 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:46.408422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e085bb2-2a30-43eb-be52-25dd1d3ad646 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:46.427920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e085bb2-2a30-43eb-be52-25dd1d3ad646 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:46.522500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f954d08-92fa-4d8d-92bb-ecc912da9346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:46.523951 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f954d08-92fa-4d8d-92bb-ecc912da9346 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:46.524444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f954d08-92fa-4d8d-92bb-ecc912da9346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:46.525240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f954d08-92fa-4d8d-92bb-ecc912da9346 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:46.526342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f954d08-92fa-4d8d-92bb-ecc912da9346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:46.528605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f954d08-92fa-4d8d-92bb-ecc912da9346 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:46.574069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1057/2088] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:46 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:46.578355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40185a94-77e5-40f3-9dae-61fe73f05436 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:46.589471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40185a94-77e5-40f3-9dae-61fe73f05436 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:46.611397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441d071-2952-47eb-8174-b12746a59173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:46.612005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441d071-2952-47eb-8174-b12746a59173 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:46.612283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441d071-2952-47eb-8174-b12746a59173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:46.612559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441d071-2952-47eb-8174-b12746a59173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:46.615972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441d071-2952-47eb-8174-b12746a59173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:46.615972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441d071-2952-47eb-8174-b12746a59173 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:46.644903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1032/2089] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:46.649108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f954d08-92fa-4d8d-92bb-ecc912da9346 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:46.665038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f954d08-92fa-4d8d-92bb-ecc912da9346 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:46.683470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a4cf6-b795-45a3-a9dc-536c63a38b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:46.684064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a4cf6-b795-45a3-a9dc-536c63a38b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:46.684347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a4cf6-b795-45a3-a9dc-536c63a38b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:46.684594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a4cf6-b795-45a3-a9dc-536c63a38b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:46.693329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a4cf6-b795-45a3-a9dc-536c63a38b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:46.695154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a4cf6-b795-45a3-a9dc-536c63a38b22 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:46.726881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1058/2090] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:46.733635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441d071-2952-47eb-8174-b12746a59173 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:46.743712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441d071-2952-47eb-8174-b12746a59173 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:46.750341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7809-f526-4930-b530-f891ae0c0ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:46.750341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7809-f526-4930-b530-f891ae0c0ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:46.750642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7809-f526-4930-b530-f891ae0c0ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:46.751031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7809-f526-4930-b530-f891ae0c0ac0 admin admin] PATH_INFO: `/v3/projects/941229a57b094a70a6feddb7cdfa8c58/users/688df99f320f475d9590553727f5b43b/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:46.768195 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e7809-f526-4930-b530-f891ae0c0ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941229a57b094a70a6feddb7cdfa8c58, user_id=688df99f320f475d9590553727f5b43b, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:46.770858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e7809-f526-4930-b530-f891ae0c0ac0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:46.798389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1033/2091] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:46 2022] PUT /identity/v3/projects/941229a57b094a70a6feddb7cdfa8c58/users/688df99f320f475d9590553727f5b43b/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:46.800423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227361e-9efd-43bb-87f5-1b4edf7e2023 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:46.801424 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227361e-9efd-43bb-87f5-1b4edf7e2023 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:46.801695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227361e-9efd-43bb-87f5-1b4edf7e2023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:46.835078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1227361e-9efd-43bb-87f5-1b4edf7e2023 None None] MFA Rules not processed for user `688df99f320f475d9590553727f5b43b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:46.836490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1227361e-9efd-43bb-87f5-1b4edf7e2023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:46.921009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1059/2092] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:46.924022 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7809-f526-4930-b530-f891ae0c0ac0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:46.997403 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7809-f526-4930-b530-f891ae0c0ac0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:47.003120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc58e0-ac86-457c-8570-f3bff0454c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:47.003898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc58e0-ac86-457c-8570-f3bff0454c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:47.004258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc58e0-ac86-457c-8570-f3bff0454c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:47.004535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc58e0-ac86-457c-8570-f3bff0454c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:47.005171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc58e0-ac86-457c-8570-f3bff0454c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:47.007091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc58e0-ac86-457c-8570-f3bff0454c77 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:47.019886 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:47.047842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1034/2093] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:46 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:47.052226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227361e-9efd-43bb-87f5-1b4edf7e2023 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:47.064318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227361e-9efd-43bb-87f5-1b4edf7e2023 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:47.099104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:47.152083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0efff9-2780-421c-b99c-1f4dc3dd2f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:47.152730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0efff9-2780-421c-b99c-1f4dc3dd2f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:47.153008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0efff9-2780-421c-b99c-1f4dc3dd2f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:47.153275 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0efff9-2780-421c-b99c-1f4dc3dd2f96 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:47.153917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0efff9-2780-421c-b99c-1f4dc3dd2f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:47.155897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0efff9-2780-421c-b99c-1f4dc3dd2f96 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:47.181851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1060/2094] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:47 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:47.185753 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc58e0-ac86-457c-8570-f3bff0454c77 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:47.196751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc58e0-ac86-457c-8570-f3bff0454c77 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:47.201786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc12c99-ad7f-41c7-a8ac-e1916c960ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:47.202732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc12c99-ad7f-41c7-a8ac-e1916c960ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:47.203008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc12c99-ad7f-41c7-a8ac-e1916c960ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:47.203982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc12c99-ad7f-41c7-a8ac-e1916c960ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:47.205876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc12c99-ad7f-41c7-a8ac-e1916c960ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:47.207531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc12c99-ad7f-41c7-a8ac-e1916c960ae4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:47.222191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1035/2095] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:47.225375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0efff9-2780-421c-b99c-1f4dc3dd2f96 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:47.240264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0efff9-2780-421c-b99c-1f4dc3dd2f96 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:47.246604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f1baf-85fd-4015-86d9-79d7fcef5c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:47.247292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f1baf-85fd-4015-86d9-79d7fcef5c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:47.247590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f1baf-85fd-4015-86d9-79d7fcef5c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:47.247856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f1baf-85fd-4015-86d9-79d7fcef5c89 admin admin] PATH_INFO: `/v3/projects/16f0cd3ede114213ab8588062fe954bd/users/31c1d27f24d34ad6adc660f66bff4e63/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:47.266359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f1baf-85fd-4015-86d9-79d7fcef5c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f0cd3ede114213ab8588062fe954bd, user_id=31c1d27f24d34ad6adc660f66bff4e63, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:47.269447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f1baf-85fd-4015-86d9-79d7fcef5c89 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:47.291184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1061/2096] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:47 2022] PUT /identity/v3/projects/16f0cd3ede114213ab8588062fe954bd/users/31c1d27f24d34ad6adc660f66bff4e63/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:47.293786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc12c99-ad7f-41c7-a8ac-e1916c960ae4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:47.305305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc12c99-ad7f-41c7-a8ac-e1916c960ae4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:47.378834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ee600-11d3-4733-89b9-3b06518daf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:47.379513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee600-11d3-4733-89b9-3b06518daf32 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:47.379790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee600-11d3-4733-89b9-3b06518daf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:47.380059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee600-11d3-4733-89b9-3b06518daf32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:47.380856 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ee600-11d3-4733-89b9-3b06518daf32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:47.382480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ee600-11d3-4733-89b9-3b06518daf32 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:47.395476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1036/2097] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:47.398358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f1baf-85fd-4015-86d9-79d7fcef5c89 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:47.409609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f1baf-85fd-4015-86d9-79d7fcef5c89 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:47.414686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267483e9-e2af-465f-be64-c84be6df8694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:47.415406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267483e9-e2af-465f-be64-c84be6df8694 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:47.415682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267483e9-e2af-465f-be64-c84be6df8694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:47.415989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267483e9-e2af-465f-be64-c84be6df8694 admin admin] PATH_INFO: `/v3/projects/16f0cd3ede114213ab8588062fe954bd/users/31c1d27f24d34ad6adc660f66bff4e63/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:47.418061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267483e9-e2af-465f-be64-c84be6df8694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f0cd3ede114213ab8588062fe954bd, user_id=31c1d27f24d34ad6adc660f66bff4e63, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:47.420726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267483e9-e2af-465f-be64-c84be6df8694 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:47.432707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1062/2098] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:47 2022] PUT /identity/v3/projects/16f0cd3ede114213ab8588062fe954bd/users/31c1d27f24d34ad6adc660f66bff4e63/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:47.443765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7761b-e023-44ff-9970-9e14fbb5e602 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:47.444046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7761b-e023-44ff-9970-9e14fbb5e602 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:47.445645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7761b-e023-44ff-9970-9e14fbb5e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:47.483229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-49b7761b-e023-44ff-9970-9e14fbb5e602 None None] MFA Rules not processed for user `31c1d27f24d34ad6adc660f66bff4e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:47.484907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-49b7761b-e023-44ff-9970-9e14fbb5e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:47.592039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1037/2099] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:47.601987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267483e9-e2af-465f-be64-c84be6df8694 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:47.603881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-267483e9-e2af-465f-be64-c84be6df8694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:47.726216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267483e9-e2af-465f-be64-c84be6df8694 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:47.734569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3633c-ac47-4cb7-b343-625ee264ba0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:47.735261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3633c-ac47-4cb7-b343-625ee264ba0a service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:47.735564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3633c-ac47-4cb7-b343-625ee264ba0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:47.735836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3633c-ac47-4cb7-b343-625ee264ba0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:47.827215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3633c-ac47-4cb7-b343-625ee264ba0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:47.828702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3633c-ac47-4cb7-b343-625ee264ba0a service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:47.861337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1063/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:48.815032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b68c8-ba49-410e-aa75-e26ffe7c1b77 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:48.815653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b68c8-ba49-410e-aa75-e26ffe7c1b77 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:48.815653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b68c8-ba49-410e-aa75-e26ffe7c1b77 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:48.817047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1038/2101] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:33:48.829188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da21fce-180d-4997-b3a2-5caa01219d86 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:48.829736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da21fce-180d-4997-b3a2-5caa01219d86 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:48.829831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da21fce-180d-4997-b3a2-5caa01219d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:48.857200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0da21fce-180d-4997-b3a2-5caa01219d86 None None] MFA Rules not processed for user `ff4e48fdc18e424fa2cf80fd5da332b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:48.858420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0da21fce-180d-4997-b3a2-5caa01219d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:48.892082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b68c8-ba49-410e-aa75-e26ffe7c1b77 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:48.893988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-172b68c8-ba49-410e-aa75-e26ffe7c1b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:48.906806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:48.943543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1064/2102] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:33:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:48.955121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da21fce-180d-4997-b3a2-5caa01219d86 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:48.957285 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0da21fce-180d-4997-b3a2-5caa01219d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:48.971440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da21fce-180d-4997-b3a2-5caa01219d86 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:48.976702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1fc41-1bf2-4b75-b37f-37b444578ad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:48.977322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1fc41-1bf2-4b75-b37f-37b444578ad9 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:48.977626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1fc41-1bf2-4b75-b37f-37b444578ad9 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:48.977889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1fc41-1bf2-4b75-b37f-37b444578ad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:48.980316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b68c8-ba49-410e-aa75-e26ffe7c1b77 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:48.986308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:48.986778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1fc41-1bf2-4b75-b37f-37b444578ad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:48.986958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:48.987231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:48.987530 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] PATH_INFO: `/v3/users/74e7a0ccd3fc41db9b9c9a7234853277` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:48.988753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1fc41-1bf2-4b75-b37f-37b444578ad9 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:48.989192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e7a0ccd3fc41db9b9c9a7234853277)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:48.991133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:48.993060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:49.000986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1065/2103] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:33:49.057679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e7a0ccd3fc41db9b9c9a7234853277'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:49.058366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e7a0ccd3fc41db9b9c9a7234853277'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:49.067010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e7a0ccd3fc41db9b9c9a7234853277'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:49.080751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e7a0ccd3fc41db9b9c9a7234853277'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:49.088684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f743050e-5a45-42a8-b5c0-55ccf91d28bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e7a0ccd3fc41db9b9c9a7234853277'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:49.095782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1039/2104] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:48 2022] DELETE /identity/v3/users/74e7a0ccd3fc41db9b9c9a7234853277 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:49.296430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1fc41-1bf2-4b75-b37f-37b444578ad9 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:49.310594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1fc41-1bf2-4b75-b37f-37b444578ad9 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:49.382850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:49.383920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:49.384267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:49.384664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] PATH_INFO: `/v3/projects/4bb59165f9cd40b6b82046e8cc3f7b09` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:49.386028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb59165f9cd40b6b82046e8cc3f7b09)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:49.388836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:49.460655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb59165f9cd40b6b82046e8cc3f7b09', 'request_id': 'req-3ede8d57-6585-4ff2-85e7-1d9010a123b3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:49.469958 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb59165f9cd40b6b82046e8cc3f7b09', 'request_id': 'req-3ede8d57-6585-4ff2-85e7-1d9010a123b3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:49.477590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb59165f9cd40b6b82046e8cc3f7b09', 'request_id': 'req-3ede8d57-6585-4ff2-85e7-1d9010a123b3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:49.489956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] The token cache is being invalidate because project 4bb59165f9cd40b6b82046e8cc3f7b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:49.490701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:49.490928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3ede8d57-6585-4ff2-85e7-1d9010a123b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:49.492910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1066/2105] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:49 2022] DELETE /identity/v3/projects/4bb59165f9cd40b6b82046e8cc3f7b09 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:49.505092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25a9d-b947-47f5-ab99-b864c367187b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:49.505378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25a9d-b947-47f5-ab99-b864c367187b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:49.505639 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25a9d-b947-47f5-ab99-b864c367187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:49.528300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-47f25a9d-b947-47f5-ab99-b864c367187b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:49.530229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-47f25a9d-b947-47f5-ab99-b864c367187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:49.619394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1040/2106] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:49.627927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055492-b8f6-485a-85ee-1cea9b80bc61 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:49.628290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055492-b8f6-485a-85ee-1cea9b80bc61 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:49.628636 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055492-b8f6-485a-85ee-1cea9b80bc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:49.661474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f4055492-b8f6-485a-85ee-1cea9b80bc61 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:49.662679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f4055492-b8f6-485a-85ee-1cea9b80bc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:49.672676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1067/2107] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:49.677412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25a9d-b947-47f5-ab99-b864c367187b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:49.688326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25a9d-b947-47f5-ab99-b864c367187b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:49.695337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3073fc8-c68a-4d01-9823-a936b3236edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:49.695970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3073fc8-c68a-4d01-9823-a936b3236edf admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:49.696225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3073fc8-c68a-4d01-9823-a936b3236edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:49.696523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3073fc8-c68a-4d01-9823-a936b3236edf admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:49.697184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3073fc8-c68a-4d01-9823-a936b3236edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:49.697476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3073fc8-c68a-4d01-9823-a936b3236edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:49.699384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3073fc8-c68a-4d01-9823-a936b3236edf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:49.711649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1041/2108] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:33:49.717078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055492-b8f6-485a-85ee-1cea9b80bc61 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:49.730333 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055492-b8f6-485a-85ee-1cea9b80bc61 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:49.737985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81ac1a-3491-4219-a52a-128ab909cf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:49.739020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81ac1a-3491-4219-a52a-128ab909cf02 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:49.739322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81ac1a-3491-4219-a52a-128ab909cf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:49.739622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81ac1a-3491-4219-a52a-128ab909cf02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:49.740322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81ac1a-3491-4219-a52a-128ab909cf02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:49.742183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81ac1a-3491-4219-a52a-128ab909cf02 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:49.782335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1068/2109] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:49 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:49.784270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3073fc8-c68a-4d01-9823-a936b3236edf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:49.796669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3073fc8-c68a-4d01-9823-a936b3236edf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:49.862115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f9d2f-7a59-4a46-b39a-d768f5637fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:49.863508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f9d2f-7a59-4a46-b39a-d768f5637fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:49.863508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f9d2f-7a59-4a46-b39a-d768f5637fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:49.863842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f9d2f-7a59-4a46-b39a-d768f5637fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:49.864420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f9d2f-7a59-4a46-b39a-d768f5637fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:49.866806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f9d2f-7a59-4a46-b39a-d768f5637fe6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:49.879400 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:49.897839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1042/2110] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:49 2022] POST /identity/v3/users => generated 282 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:49.903293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81ac1a-3491-4219-a52a-128ab909cf02 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:49.919907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81ac1a-3491-4219-a52a-128ab909cf02 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:49.930541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefbb92-c845-46c6-ae2b-18741d6c892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:49.931410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefbb92-c845-46c6-ae2b-18741d6c892d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:49.931896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefbb92-c845-46c6-ae2b-18741d6c892d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:49.932267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefbb92-c845-46c6-ae2b-18741d6c892d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:49.933008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefbb92-c845-46c6-ae2b-18741d6c892d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:49.934839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefbb92-c845-46c6-ae2b-18741d6c892d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:49.951494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1069/2111] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:49.952228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f9d2f-7a59-4a46-b39a-d768f5637fe6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:49.963083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f9d2f-7a59-4a46-b39a-d768f5637fe6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:49.970602 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c076-9732-4ed7-bff5-bd9bd4d8b490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:49.971226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c076-9732-4ed7-bff5-bd9bd4d8b490 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:49.971534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c076-9732-4ed7-bff5-bd9bd4d8b490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:49.971813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c076-9732-4ed7-bff5-bd9bd4d8b490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:49.972460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c076-9732-4ed7-bff5-bd9bd4d8b490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:49.974380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c076-9732-4ed7-bff5-bd9bd4d8b490 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:49.986271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1043/2112] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:49.991000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefbb92-c845-46c6-ae2b-18741d6c892d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:50.006690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefbb92-c845-46c6-ae2b-18741d6c892d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:50.011659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152186fb-d9da-4bd2-abb2-c1ad10d777a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:50.012328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152186fb-d9da-4bd2-abb2-c1ad10d777a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:50.012622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152186fb-d9da-4bd2-abb2-c1ad10d777a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:50.012867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152186fb-d9da-4bd2-abb2-c1ad10d777a9 admin admin] PATH_INFO: `/v3/projects/1fa64ea4f78e49c2a359dcd8a6e1eabd/users/a95ff3d069a64681806c05c0b4b5d075/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:50.022431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:50.030151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152186fb-d9da-4bd2-abb2-c1ad10d777a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa64ea4f78e49c2a359dcd8a6e1eabd, user_id=a95ff3d069a64681806c05c0b4b5d075, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:50.033621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152186fb-d9da-4bd2-abb2-c1ad10d777a9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:50.048536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1070/2113] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:49 2022] PUT /identity/v3/projects/1fa64ea4f78e49c2a359dcd8a6e1eabd/users/a95ff3d069a64681806c05c0b4b5d075/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:50.059237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1e14-25bc-4e46-a7bf-f2b6003e3a93 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:50.059539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1e14-25bc-4e46-a7bf-f2b6003e3a93 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:50.059807 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1e14-25bc-4e46-a7bf-f2b6003e3a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:50.087796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-096b1e14-25bc-4e46-a7bf-f2b6003e3a93 None None] MFA Rules not processed for user `a95ff3d069a64681806c05c0b4b5d075`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:50.089061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-096b1e14-25bc-4e46-a7bf-f2b6003e3a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:50.155578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1044/2114] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:50.160565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152186fb-d9da-4bd2-abb2-c1ad10d777a9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:50.230625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152186fb-d9da-4bd2-abb2-c1ad10d777a9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:50.235542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017a2eb-d3a0-47fe-8a39-47a994f2172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:50.236154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017a2eb-d3a0-47fe-8a39-47a994f2172b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:50.236428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017a2eb-d3a0-47fe-8a39-47a994f2172b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:50.236693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017a2eb-d3a0-47fe-8a39-47a994f2172b admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:50.237362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017a2eb-d3a0-47fe-8a39-47a994f2172b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:50.239638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017a2eb-d3a0-47fe-8a39-47a994f2172b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:50.269781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1071/2115] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:50 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:50.274671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b1e14-25bc-4e46-a7bf-f2b6003e3a93 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:50.286744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b1e14-25bc-4e46-a7bf-f2b6003e3a93 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:50.359114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ee140-7bc6-4dba-bb4d-2c1e2d59312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:50.359754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ee140-7bc6-4dba-bb4d-2c1e2d59312c admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:50.360025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ee140-7bc6-4dba-bb4d-2c1e2d59312c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:50.360285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ee140-7bc6-4dba-bb4d-2c1e2d59312c admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:50.360936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ee140-7bc6-4dba-bb4d-2c1e2d59312c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:50.362861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ee140-7bc6-4dba-bb4d-2c1e2d59312c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:50.386408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1045/2116] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:50 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:50.390570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017a2eb-d3a0-47fe-8a39-47a994f2172b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:50.401342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017a2eb-d3a0-47fe-8a39-47a994f2172b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:50.406469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9457-7350-4232-b28d-c9a0dc4e0dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:50.407083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9457-7350-4232-b28d-c9a0dc4e0dac admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:50.407521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9457-7350-4232-b28d-c9a0dc4e0dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:50.408574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9457-7350-4232-b28d-c9a0dc4e0dac admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:50.409267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab9457-7350-4232-b28d-c9a0dc4e0dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:50.410869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab9457-7350-4232-b28d-c9a0dc4e0dac admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:50.422614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1072/2117] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:50.427717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ee140-7bc6-4dba-bb4d-2c1e2d59312c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:50.447375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ee140-7bc6-4dba-bb4d-2c1e2d59312c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:50.454549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa1f5d-7c94-40c6-8afb-cd5cbde7e27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:50.455212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1f5d-7c94-40c6-8afb-cd5cbde7e27f admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:50.455525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1f5d-7c94-40c6-8afb-cd5cbde7e27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:50.455794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1f5d-7c94-40c6-8afb-cd5cbde7e27f admin admin] PATH_INFO: `/v3/projects/1f48a88fef7844aaba00cde39f00b705/users/de736d9a580647eca958860695dec308/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:50.472333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa1f5d-7c94-40c6-8afb-cd5cbde7e27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f48a88fef7844aaba00cde39f00b705, user_id=de736d9a580647eca958860695dec308, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:50.475007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa1f5d-7c94-40c6-8afb-cd5cbde7e27f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:50.489410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1046/2118] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:50 2022] PUT /identity/v3/projects/1f48a88fef7844aaba00cde39f00b705/users/de736d9a580647eca958860695dec308/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:50.493619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9457-7350-4232-b28d-c9a0dc4e0dac admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:50.504549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9457-7350-4232-b28d-c9a0dc4e0dac admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:50.563712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae86f7-9399-45f3-b9aa-0cf33832d34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:50.564226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae86f7-9399-45f3-b9aa-0cf33832d34e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:50.564497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae86f7-9399-45f3-b9aa-0cf33832d34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:50.564762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae86f7-9399-45f3-b9aa-0cf33832d34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:50.565400 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae86f7-9399-45f3-b9aa-0cf33832d34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:50.566981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae86f7-9399-45f3-b9aa-0cf33832d34e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:50.576932 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1073/2119] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:50.581300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa1f5d-7c94-40c6-8afb-cd5cbde7e27f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:50.591712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa1f5d-7c94-40c6-8afb-cd5cbde7e27f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:50.596752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d671d69-f099-42c0-b632-95b3d2ccb883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:50.597389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d671d69-f099-42c0-b632-95b3d2ccb883 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:50.597657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d671d69-f099-42c0-b632-95b3d2ccb883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:50.597917 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d671d69-f099-42c0-b632-95b3d2ccb883 admin admin] PATH_INFO: `/v3/projects/1f48a88fef7844aaba00cde39f00b705/users/de736d9a580647eca958860695dec308/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:50.600047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d671d69-f099-42c0-b632-95b3d2ccb883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f48a88fef7844aaba00cde39f00b705, user_id=de736d9a580647eca958860695dec308, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:50.602727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d671d69-f099-42c0-b632-95b3d2ccb883 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:50.614059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1047/2120] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:50 2022] PUT /identity/v3/projects/1f48a88fef7844aaba00cde39f00b705/users/de736d9a580647eca958860695dec308/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:50.625532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1e854-7689-4851-a868-6bc51a4365ed None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:50.625813 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1e854-7689-4851-a868-6bc51a4365ed None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:50.626079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1e854-7689-4851-a868-6bc51a4365ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:50.655460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0ad1e854-7689-4851-a868-6bc51a4365ed None None] MFA Rules not processed for user `de736d9a580647eca958860695dec308`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:50.656945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0ad1e854-7689-4851-a868-6bc51a4365ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:50.704929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:50.731001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1074/2121] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:50.743698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d671d69-f099-42c0-b632-95b3d2ccb883 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:50.745749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1d671d69-f099-42c0-b632-95b3d2ccb883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:50.779671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:50.809420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d671d69-f099-42c0-b632-95b3d2ccb883 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:50.813163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecfb00-3c6f-4091-87cc-e3e556f8262a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:50.813829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecfb00-3c6f-4091-87cc-e3e556f8262a service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:50.814037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecfb00-3c6f-4091-87cc-e3e556f8262a service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:50.814299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecfb00-3c6f-4091-87cc-e3e556f8262a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:50.825068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecfb00-3c6f-4091-87cc-e3e556f8262a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:50.826792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecfb00-3c6f-4091-87cc-e3e556f8262a service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:50.837356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1048/2122] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:51.331539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1e854-7689-4851-a868-6bc51a4365ed None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:51.416921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1e854-7689-4851-a868-6bc51a4365ed None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:51.423663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:51.424309 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:51.424588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:51.426096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] PATH_INFO: `/v3/users/a95ff3d069a64681806c05c0b4b5d075` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:51.426700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95ff3d069a64681806c05c0b4b5d075)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:51.428804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:51.479104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95ff3d069a64681806c05c0b4b5d075'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:51.487779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95ff3d069a64681806c05c0b4b5d075'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:51.500030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95ff3d069a64681806c05c0b4b5d075'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:51.500740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95ff3d069a64681806c05c0b4b5d075'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:51.507757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95ff3d069a64681806c05c0b4b5d075'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:51.513737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1075/2123] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:51 2022] DELETE /identity/v3/users/a95ff3d069a64681806c05c0b4b5d075 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:51.518293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d03b5-0550-44d4-b049-0925e3651daa None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:51.518779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d03b5-0550-44d4-b049-0925e3651daa None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:51.518779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d03b5-0550-44d4-b049-0925e3651daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:51.538274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ee3d03b5-0550-44d4-b049-0925e3651daa None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:51.539528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ee3d03b5-0550-44d4-b049-0925e3651daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:51.603454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1049/2124] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:51.613779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:51.615233 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:51.678026 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97cbb-6036-4445-ae08-3a00a6715384 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:51.681872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0aee9d-0d68-4e7b-a056-16bf70a61e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:51.682566 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0aee9d-0d68-4e7b-a056-16bf70a61e7a service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:51.682850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0aee9d-0d68-4e7b-a056-16bf70a61e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:51.683122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0aee9d-0d68-4e7b-a056-16bf70a61e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:51.693389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0aee9d-0d68-4e7b-a056-16bf70a61e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:51.694864 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0aee9d-0d68-4e7b-a056-16bf70a61e7a service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:51.705504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1076/2125] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:52.074099 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d03b5-0550-44d4-b049-0925e3651daa None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:52.075762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ee3d03b5-0550-44d4-b049-0925e3651daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:52.089590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d03b5-0550-44d4-b049-0925e3651daa None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:52.096507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:52.097609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:52.098676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:52.099264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] PATH_INFO: `/v3/projects/1fa64ea4f78e49c2a359dcd8a6e1eabd` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:52.101011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa64ea4f78e49c2a359dcd8a6e1eabd)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:52.105580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:52.182464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa64ea4f78e49c2a359dcd8a6e1eabd', 'request_id': 'req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.191743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa64ea4f78e49c2a359dcd8a6e1eabd', 'request_id': 'req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.197621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa64ea4f78e49c2a359dcd8a6e1eabd', 'request_id': 'req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.209422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] The token cache is being invalidate because project 1fa64ea4f78e49c2a359dcd8a6e1eabd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:52.209707 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.210472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.212008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1050/2126] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:52 2022] DELETE /identity/v3/projects/1fa64ea4f78e49c2a359dcd8a6e1eabd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:52.216231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0aee9d-0d68-4e7b-a056-16bf70a61e7a service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:52.222720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:52.226501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0aee9d-0d68-4e7b-a056-16bf70a61e7a service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:52.293298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:52.293952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:52.294228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:52.294497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] PATH_INFO: `/v3/users/de736d9a580647eca958860695dec308` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:52.295695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de736d9a580647eca958860695dec308)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:52.297649 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:52.357982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de736d9a580647eca958860695dec308'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.365452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de736d9a580647eca958860695dec308'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.379480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de736d9a580647eca958860695dec308'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.380205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de736d9a580647eca958860695dec308'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.387479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de736d9a580647eca958860695dec308'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.394483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1077/2127] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:52 2022] DELETE /identity/v3/users/de736d9a580647eca958860695dec308 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:52.532264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:52.533938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:52.608148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbc750-29d1-468b-98ef-1ae82c7e92fb admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:52.612706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:52.662034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c25e5a-5b02-419a-9d95-7fb03b43d13c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:52.662891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c25e5a-5b02-419a-9d95-7fb03b43d13c service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:52.663177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c25e5a-5b02-419a-9d95-7fb03b43d13c service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:52.663561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c25e5a-5b02-419a-9d95-7fb03b43d13c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:52.665757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-03c25e5a-5b02-419a-9d95-7fb03b43d13c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:52.675870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:52.677378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:52.731942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c25e5a-5b02-419a-9d95-7fb03b43d13c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:52.733397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c25e5a-5b02-419a-9d95-7fb03b43d13c service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:52.743859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1051/2128] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:52.757767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67fb11-386a-40ba-b45d-dfb82f319888 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:52.762692 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:52.763356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:52.763637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:52.763903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] PATH_INFO: `/v3/projects/1f48a88fef7844aaba00cde39f00b705` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:52.765002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f48a88fef7844aaba00cde39f00b705)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:52.766899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:52.802085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:52.826388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f48a88fef7844aaba00cde39f00b705', 'request_id': 'req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.835076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f48a88fef7844aaba00cde39f00b705', 'request_id': 'req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.841025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f48a88fef7844aaba00cde39f00b705', 'request_id': 'req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.852322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] The token cache is being invalidate because project 1f48a88fef7844aaba00cde39f00b705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:52.852608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.853243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d93b2eb3-6f57-4b52-9bb1-4fc05a03df74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:52.854921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1078/2129] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:52 2022] DELETE /identity/v3/projects/1f48a88fef7844aaba00cde39f00b705 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:52.860510 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154873-e428-4e17-aed7-dfee9150df1f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:52.861002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154873-e428-4e17-aed7-dfee9150df1f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:52.861353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154873-e428-4e17-aed7-dfee9150df1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:52.882633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9f154873-e428-4e17-aed7-dfee9150df1f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:52.883858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9f154873-e428-4e17-aed7-dfee9150df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:52.948610 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1052/2130] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:52.950461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc9092-0ad8-4f95-be6d-1267066c030b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:52.950753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc9092-0ad8-4f95-be6d-1267066c030b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:52.951193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc9092-0ad8-4f95-be6d-1267066c030b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:52.974686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e4bc9092-0ad8-4f95-be6d-1267066c030b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:52.976010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e4bc9092-0ad8-4f95-be6d-1267066c030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:52.988683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1079/2131] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:52.989615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154873-e428-4e17-aed7-dfee9150df1f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.006702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154873-e428-4e17-aed7-dfee9150df1f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.012556 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276d43-2175-4086-90b4-e8a7e642154d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.013170 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276d43-2175-4086-90b4-e8a7e642154d admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.013447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276d43-2175-4086-90b4-e8a7e642154d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.013717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276d43-2175-4086-90b4-e8a7e642154d admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.014367 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276d43-2175-4086-90b4-e8a7e642154d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:53.014723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276d43-2175-4086-90b4-e8a7e642154d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.017146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276d43-2175-4086-90b4-e8a7e642154d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.044146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1053/2132] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:33:53.047822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc9092-0ad8-4f95-be6d-1267066c030b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.058947 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc9092-0ad8-4f95-be6d-1267066c030b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.066906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4086d2-270d-4e12-ba2d-0c4dc1aa313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.067974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4086d2-270d-4e12-ba2d-0c4dc1aa313e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.068523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4086d2-270d-4e12-ba2d-0c4dc1aa313e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.068899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4086d2-270d-4e12-ba2d-0c4dc1aa313e admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.070376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4086d2-270d-4e12-ba2d-0c4dc1aa313e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.072074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4086d2-270d-4e12-ba2d-0c4dc1aa313e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.117493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1080/2133] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:53 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:53.118645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276d43-2175-4086-90b4-e8a7e642154d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.129453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276d43-2175-4086-90b4-e8a7e642154d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.180855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:53.202160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850cdd-1b78-4d90-8d17-bc65d2b3d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.202945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850cdd-1b78-4d90-8d17-bc65d2b3d43e admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.203281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850cdd-1b78-4d90-8d17-bc65d2b3d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.203704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850cdd-1b78-4d90-8d17-bc65d2b3d43e admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.205244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff850cdd-1b78-4d90-8d17-bc65d2b3d43e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.207864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff850cdd-1b78-4d90-8d17-bc65d2b3d43e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.239283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1054/2134] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:53 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:53.240528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4086d2-270d-4e12-ba2d-0c4dc1aa313e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.252483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4086d2-270d-4e12-ba2d-0c4dc1aa313e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.257091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53877567-1aec-46f4-802c-31d32df08e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.257725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53877567-1aec-46f4-802c-31d32df08e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.257988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53877567-1aec-46f4-802c-31d32df08e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.258254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53877567-1aec-46f4-802c-31d32df08e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.258920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53877567-1aec-46f4-802c-31d32df08e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.260892 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53877567-1aec-46f4-802c-31d32df08e2d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.274410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1081/2135] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:53.275605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850cdd-1b78-4d90-8d17-bc65d2b3d43e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.285722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850cdd-1b78-4d90-8d17-bc65d2b3d43e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.290335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e5dc-da8d-4dc8-ba9e-338c620f7a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.290936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e5dc-da8d-4dc8-ba9e-338c620f7a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.291216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e5dc-da8d-4dc8-ba9e-338c620f7a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.291514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e5dc-da8d-4dc8-ba9e-338c620f7a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.292474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5e5dc-da8d-4dc8-ba9e-338c620f7a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.294088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5e5dc-da8d-4dc8-ba9e-338c620f7a70 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.305959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1055/2136] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:53.309893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53877567-1aec-46f4-802c-31d32df08e2d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.329025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53877567-1aec-46f4-802c-31d32df08e2d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.333911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e75467-3a97-431f-8cb8-984ecb6be451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.334653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75467-3a97-431f-8cb8-984ecb6be451 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.336544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75467-3a97-431f-8cb8-984ecb6be451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.336887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75467-3a97-431f-8cb8-984ecb6be451 admin admin] PATH_INFO: `/v3/projects/6a5ee8f40fd74373b95b26413317cd1d/users/d9d8dda13d57490480e49b94737e9590/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.357725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e75467-3a97-431f-8cb8-984ecb6be451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5ee8f40fd74373b95b26413317cd1d, user_id=d9d8dda13d57490480e49b94737e9590, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.362015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e75467-3a97-431f-8cb8-984ecb6be451 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.381217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1082/2137] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:53 2022] PUT /identity/v3/projects/6a5ee8f40fd74373b95b26413317cd1d/users/d9d8dda13d57490480e49b94737e9590/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:53.394201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96e9b6-0918-4b64-b3ad-cbb962d3e406 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.394201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96e9b6-0918-4b64-b3ad-cbb962d3e406 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.394361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96e9b6-0918-4b64-b3ad-cbb962d3e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.426232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-eb96e9b6-0918-4b64-b3ad-cbb962d3e406 None None] MFA Rules not processed for user `d9d8dda13d57490480e49b94737e9590`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:53.427494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-eb96e9b6-0918-4b64-b3ad-cbb962d3e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:53.494236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1056/2138] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:53.498980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e75467-3a97-431f-8cb8-984ecb6be451 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.573847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e75467-3a97-431f-8cb8-984ecb6be451 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.580029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2c5e9-0b13-4427-a56c-d617d3a7592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.580662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2c5e9-0b13-4427-a56c-d617d3a7592d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.580952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2c5e9-0b13-4427-a56c-d617d3a7592d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.581217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2c5e9-0b13-4427-a56c-d617d3a7592d admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.581865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2c5e9-0b13-4427-a56c-d617d3a7592d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.583988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2c5e9-0b13-4427-a56c-d617d3a7592d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.612854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1083/2139] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:53 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:53.617493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96e9b6-0918-4b64-b3ad-cbb962d3e406 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.628785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96e9b6-0918-4b64-b3ad-cbb962d3e406 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.687517 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7651-d1d6-4d44-b858-9430ce45b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.688118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7651-d1d6-4d44-b858-9430ce45b87a admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.688366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7651-d1d6-4d44-b858-9430ce45b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.688653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7651-d1d6-4d44-b858-9430ce45b87a admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.689286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a7651-d1d6-4d44-b858-9430ce45b87a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.691203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a7651-d1d6-4d44-b858-9430ce45b87a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.714264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1057/2140] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:53 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:53.720477 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2c5e9-0b13-4427-a56c-d617d3a7592d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.734103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2c5e9-0b13-4427-a56c-d617d3a7592d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.740073 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3c13d-ab43-41cb-967f-03e88d77a042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.740671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3c13d-ab43-41cb-967f-03e88d77a042 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.740946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3c13d-ab43-41cb-967f-03e88d77a042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.741214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3c13d-ab43-41cb-967f-03e88d77a042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.741864 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3c13d-ab43-41cb-967f-03e88d77a042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.743499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3c13d-ab43-41cb-967f-03e88d77a042 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.754537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1084/2141] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:53.759096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7651-d1d6-4d44-b858-9430ce45b87a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.769419 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7651-d1d6-4d44-b858-9430ce45b87a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.774485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafffc3-34b6-47a2-8436-d13d2070d206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.775140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafffc3-34b6-47a2-8436-d13d2070d206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.775444 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafffc3-34b6-47a2-8436-d13d2070d206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.775713 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafffc3-34b6-47a2-8436-d13d2070d206 admin admin] PATH_INFO: `/v3/projects/f0f9d2a1b3054ef280ec92c2166e3b48/users/e6cf864e8e374c01b11206c173033671/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.790893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafffc3-34b6-47a2-8436-d13d2070d206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f9d2a1b3054ef280ec92c2166e3b48, user_id=e6cf864e8e374c01b11206c173033671, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.793898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafffc3-34b6-47a2-8436-d13d2070d206 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.809755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1058/2142] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:53 2022] PUT /identity/v3/projects/f0f9d2a1b3054ef280ec92c2166e3b48/users/e6cf864e8e374c01b11206c173033671/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:53.813673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3c13d-ab43-41cb-967f-03e88d77a042 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.823963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3c13d-ab43-41cb-967f-03e88d77a042 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.846004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:53.886420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c29aa0-9394-4fa6-8037-f7c5669fefbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.886975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c29aa0-9394-4fa6-8037-f7c5669fefbf admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.887252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c29aa0-9394-4fa6-8037-f7c5669fefbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.887546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c29aa0-9394-4fa6-8037-f7c5669fefbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.888195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c29aa0-9394-4fa6-8037-f7c5669fefbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.889815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c29aa0-9394-4fa6-8037-f7c5669fefbf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.900144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1085/2143] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:53.904749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafffc3-34b6-47a2-8436-d13d2070d206 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:53.919237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafffc3-34b6-47a2-8436-d13d2070d206 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:53.928242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32e5b-22dc-43a7-932a-6fd256473ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:53.928897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32e5b-22dc-43a7-932a-6fd256473ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.929174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32e5b-22dc-43a7-932a-6fd256473ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.929442 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32e5b-22dc-43a7-932a-6fd256473ce0 admin admin] PATH_INFO: `/v3/projects/f0f9d2a1b3054ef280ec92c2166e3b48/users/e6cf864e8e374c01b11206c173033671/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.931671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d32e5b-22dc-43a7-932a-6fd256473ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f9d2a1b3054ef280ec92c2166e3b48, user_id=e6cf864e8e374c01b11206c173033671, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:53.934600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d32e5b-22dc-43a7-932a-6fd256473ce0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:53.945317 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1059/2144] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:53 2022] PUT /identity/v3/projects/f0f9d2a1b3054ef280ec92c2166e3b48/users/e6cf864e8e374c01b11206c173033671/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:53.957047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f6d6-eac9-49f8-a74e-da7dada26ffd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:53.957443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f6d6-eac9-49f8-a74e-da7dada26ffd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:53.957716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f6d6-eac9-49f8-a74e-da7dada26ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:53.986843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-df56f6d6-eac9-49f8-a74e-da7dada26ffd None None] MFA Rules not processed for user `e6cf864e8e374c01b11206c173033671`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:53.988495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-df56f6d6-eac9-49f8-a74e-da7dada26ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:54.059783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1086/2145] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:54.071472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32e5b-22dc-43a7-932a-6fd256473ce0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:54.073972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-36d32e5b-22dc-43a7-932a-6fd256473ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:54.087755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:54.147202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32e5b-22dc-43a7-932a-6fd256473ce0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:54.151849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902c16c-ed9b-4796-a52a-90f932f6a164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:54.152464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902c16c-ed9b-4796-a52a-90f932f6a164 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:54.152741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902c16c-ed9b-4796-a52a-90f932f6a164 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:54.153030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902c16c-ed9b-4796-a52a-90f932f6a164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:54.162724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902c16c-ed9b-4796-a52a-90f932f6a164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:54.164181 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902c16c-ed9b-4796-a52a-90f932f6a164 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:54.175506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1060/2146] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:54 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:54.324881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56f6d6-eac9-49f8-a74e-da7dada26ffd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:54.395820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56f6d6-eac9-49f8-a74e-da7dada26ffd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:54.401335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:54.402048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:54.402331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:54.402602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] PATH_INFO: `/v3/users/d9d8dda13d57490480e49b94737e9590` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:54.403896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d8dda13d57490480e49b94737e9590)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:54.406114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:54.512050 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d8dda13d57490480e49b94737e9590'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:54.514240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:54.527747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d8dda13d57490480e49b94737e9590'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:54.548912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d8dda13d57490480e49b94737e9590'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:54.549759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d8dda13d57490480e49b94737e9590'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:54.561814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d8dda13d57490480e49b94737e9590'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:54.570640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1087/2147] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:54 2022] DELETE /identity/v3/users/d9d8dda13d57490480e49b94737e9590 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:54.575952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2390-b8e3-4b1b-bbee-1550d4a43a8e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:54.576791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2390-b8e3-4b1b-bbee-1550d4a43a8e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:54.577071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2390-b8e3-4b1b-bbee-1550d4a43a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:54.603718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-227f2390-b8e3-4b1b-bbee-1550d4a43a8e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:54.604954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-227f2390-b8e3-4b1b-bbee-1550d4a43a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:54.681661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1061/2148] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:54.692950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:54.694658 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:54.778917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed97b9-fb4f-4493-a258-87627caa8ad6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:54.783107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19ef6-d647-4747-91f8-c2af96133655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:54.783948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19ef6-d647-4747-91f8-c2af96133655 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:54.784297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19ef6-d647-4747-91f8-c2af96133655 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:54.784920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19ef6-d647-4747-91f8-c2af96133655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:54.798783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df19ef6-d647-4747-91f8-c2af96133655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:54.800510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df19ef6-d647-4747-91f8-c2af96133655 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:54.817866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1088/2149] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:33:55.105004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2390-b8e3-4b1b-bbee-1550d4a43a8e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:55.107090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-227f2390-b8e3-4b1b-bbee-1550d4a43a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:55.131434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2390-b8e3-4b1b-bbee-1550d4a43a8e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:55.137309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:55.137989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:55.138318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:55.138592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] PATH_INFO: `/v3/projects/6a5ee8f40fd74373b95b26413317cd1d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:55.139839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5ee8f40fd74373b95b26413317cd1d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:55.141816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:55.189970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5ee8f40fd74373b95b26413317cd1d', 'request_id': 'req-920cf1cd-3ce7-46d7-9988-a27556cf4d39'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.198168 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5ee8f40fd74373b95b26413317cd1d', 'request_id': 'req-920cf1cd-3ce7-46d7-9988-a27556cf4d39'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.204265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5ee8f40fd74373b95b26413317cd1d', 'request_id': 'req-920cf1cd-3ce7-46d7-9988-a27556cf4d39'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.215540 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] The token cache is being invalidate because project 6a5ee8f40fd74373b95b26413317cd1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:55.215823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.216486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.217992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1062/2150] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:55 2022] DELETE /identity/v3/projects/6a5ee8f40fd74373b95b26413317cd1d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:55.222144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19ef6-d647-4747-91f8-c2af96133655 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:55.231811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19ef6-d647-4747-91f8-c2af96133655 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:55.292563 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:55.293201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:55.293475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:55.293748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] PATH_INFO: `/v3/users/e6cf864e8e374c01b11206c173033671` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:55.294955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6cf864e8e374c01b11206c173033671)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:55.296966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:55.345489 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6cf864e8e374c01b11206c173033671'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.353962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6cf864e8e374c01b11206c173033671'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.366898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:55.368804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6cf864e8e374c01b11206c173033671'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.369553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6cf864e8e374c01b11206c173033671'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.378365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7362a4a3-6818-439f-bb92-85ab5c06d777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6cf864e8e374c01b11206c173033671'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.387952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1089/2151] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:55 2022] DELETE /identity/v3/users/e6cf864e8e374c01b11206c173033671 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:55.680348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:55.682063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:55.698076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cf1cd-3ce7-46d7-9988-a27556cf4d39 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:55.731652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:55.763407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:55.763890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:55.764170 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:55.764447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] PATH_INFO: `/v3/projects/f0f9d2a1b3054ef280ec92c2166e3b48` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:55.765603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f9d2a1b3054ef280ec92c2166e3b48)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:55.769120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:55.829128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f9d2a1b3054ef280ec92c2166e3b48', 'request_id': 'req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.839245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f9d2a1b3054ef280ec92c2166e3b48', 'request_id': 'req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.846076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f9d2a1b3054ef280ec92c2166e3b48', 'request_id': 'req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.858638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] The token cache is being invalidate because project f0f9d2a1b3054ef280ec92c2166e3b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:55.858925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.859630 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e78614fc-5ec8-4baf-b01f-e88f3a19a87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:55.861178 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1063/2152] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:55 2022] DELETE /identity/v3/projects/f0f9d2a1b3054ef280ec92c2166e3b48 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:55.866463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9c924-90e2-4e41-821d-b18ded0061ca None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:55.866952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9c924-90e2-4e41-821d-b18ded0061ca None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:55.867045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9c924-90e2-4e41-821d-b18ded0061ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:55.891846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-38e9c924-90e2-4e41-821d-b18ded0061ca None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:55.893251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-38e9c924-90e2-4e41-821d-b18ded0061ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:55.961269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1090/2153] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:55.969115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69972173-da8a-4381-994a-83b72acc16a3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:55.969686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69972173-da8a-4381-994a-83b72acc16a3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:55.970278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69972173-da8a-4381-994a-83b72acc16a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:55.986046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9c924-90e2-4e41-821d-b18ded0061ca None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:55.990817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-38e9c924-90e2-4e41-821d-b18ded0061ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:56.003439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9c924-90e2-4e41-821d-b18ded0061ca None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.003835 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-69972173-da8a-4381-994a-83b72acc16a3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:56.005133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-69972173-da8a-4381-994a-83b72acc16a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:56.011229 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.011935 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.012212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.012480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] PATH_INFO: `/v3/users/f6830941e8744052ad8f12964e42d8d7` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.013704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6830941e8744052ad8f12964e42d8d7)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.015689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.019048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1064/2154] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:56.019993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69972173-da8a-4381-994a-83b72acc16a3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.028906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69972173-da8a-4381-994a-83b72acc16a3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.033492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca783fc-e99f-4b9a-87a9-018a90b9a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.034097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca783fc-e99f-4b9a-87a9-018a90b9a4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.034371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca783fc-e99f-4b9a-87a9-018a90b9a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.034664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca783fc-e99f-4b9a-87a9-018a90b9a4a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.035324 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca783fc-e99f-4b9a-87a9-018a90b9a4a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:56.035630 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca783fc-e99f-4b9a-87a9-018a90b9a4a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.037228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca783fc-e99f-4b9a-87a9-018a90b9a4a5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.054217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1065/2155] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:33:56.055332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca783fc-e99f-4b9a-87a9-018a90b9a4a5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.065659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca783fc-e99f-4b9a-87a9-018a90b9a4a5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.068145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6830941e8744052ad8f12964e42d8d7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:56.070284 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf2ec1-8d8e-4cc7-83ff-aea601514ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.070882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf2ec1-8d8e-4cc7-83ff-aea601514ded admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.071161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf2ec1-8d8e-4cc7-83ff-aea601514ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.071475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf2ec1-8d8e-4cc7-83ff-aea601514ded admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.072130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf2ec1-8d8e-4cc7-83ff-aea601514ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.074236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf2ec1-8d8e-4cc7-83ff-aea601514ded admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.076952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6830941e8744052ad8f12964e42d8d7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:56.089409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6830941e8744052ad8f12964e42d8d7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:56.090076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6830941e8744052ad8f12964e42d8d7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:56.097819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be119cf3-40eb-421f-8c40-955c649cc1c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6830941e8744052ad8f12964e42d8d7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:56.102254 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1066/2156] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:56.104101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1091/2157] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:55 2022] DELETE /identity/v3/users/f6830941e8744052ad8f12964e42d8d7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:56.106279 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf2ec1-8d8e-4cc7-83ff-aea601514ded admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.107966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a9bf2ec1-8d8e-4cc7-83ff-aea601514ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:56.108234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2afb50-f12b-4cfe-a6ed-d29c3750f8ed None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.108527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2afb50-f12b-4cfe-a6ed-d29c3750f8ed None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.108805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2afb50-f12b-4cfe-a6ed-d29c3750f8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.127987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1e2afb50-f12b-4cfe-a6ed-d29c3750f8ed None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:56.129201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1e2afb50-f12b-4cfe-a6ed-d29c3750f8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:56.172995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf2ec1-8d8e-4cc7-83ff-aea601514ded admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.179895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:56.190022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1092/2158] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:56.199363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:56.200048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2afb50-f12b-4cfe-a6ed-d29c3750f8ed None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.201922 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1e2afb50-f12b-4cfe-a6ed-d29c3750f8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:56.232420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369c3d1-95d0-47b6-b3ed-d14189de6921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.233037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369c3d1-95d0-47b6-b3ed-d14189de6921 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.233336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369c3d1-95d0-47b6-b3ed-d14189de6921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.233611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369c3d1-95d0-47b6-b3ed-d14189de6921 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.234276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369c3d1-95d0-47b6-b3ed-d14189de6921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.236319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369c3d1-95d0-47b6-b3ed-d14189de6921 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.258448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1067/2159] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:56.261201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2afb50-f12b-4cfe-a6ed-d29c3750f8ed None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.262803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369c3d1-95d0-47b6-b3ed-d14189de6921 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.265242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8f5d-1e5f-48fe-acdc-fbad6bad4a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.265865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8f5d-1e5f-48fe-acdc-fbad6bad4a92 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.266135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8f5d-1e5f-48fe-acdc-fbad6bad4a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.266400 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8f5d-1e5f-48fe-acdc-fbad6bad4a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.273048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369c3d1-95d0-47b6-b3ed-d14189de6921 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.275551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc8f5d-1e5f-48fe-acdc-fbad6bad4a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.276974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc8f5d-1e5f-48fe-acdc-fbad6bad4a92 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.278194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b97a9-3b34-4ad2-ac37-9177e4450b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.278810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b97a9-3b34-4ad2-ac37-9177e4450b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.279089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b97a9-3b34-4ad2-ac37-9177e4450b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.279407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b97a9-3b34-4ad2-ac37-9177e4450b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.280024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b97a9-3b34-4ad2-ac37-9177e4450b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.281622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b97a9-3b34-4ad2-ac37-9177e4450b55 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.286269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1093/2160] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:33:56.295140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1068/2161] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:56.296377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8f5d-1e5f-48fe-acdc-fbad6bad4a92 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.306101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8f5d-1e5f-48fe-acdc-fbad6bad4a92 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.311490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984e163-ccce-421e-b6ac-80fcfbba7884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.312597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e163-ccce-421e-b6ac-80fcfbba7884 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.312876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e163-ccce-421e-b6ac-80fcfbba7884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.313317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e163-ccce-421e-b6ac-80fcfbba7884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.314000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984e163-ccce-421e-b6ac-80fcfbba7884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.315835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984e163-ccce-421e-b6ac-80fcfbba7884 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.326910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1094/2162] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:56.331390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b97a9-3b34-4ad2-ac37-9177e4450b55 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.341408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b97a9-3b34-4ad2-ac37-9177e4450b55 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.346941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9780e38-5c7f-49ce-bd6c-b2b1d7031171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.347624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9780e38-5c7f-49ce-bd6c-b2b1d7031171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.347902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9780e38-5c7f-49ce-bd6c-b2b1d7031171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.348175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9780e38-5c7f-49ce-bd6c-b2b1d7031171 admin admin] PATH_INFO: `/v3/projects/97014d2ffa604a69b2ff62ac31c01194/users/6fed0d624f044b24bd94d57fbe4d25bd/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.364347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9780e38-5c7f-49ce-bd6c-b2b1d7031171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97014d2ffa604a69b2ff62ac31c01194, user_id=6fed0d624f044b24bd94d57fbe4d25bd, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.367173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9780e38-5c7f-49ce-bd6c-b2b1d7031171 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.380642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1069/2163] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:56 2022] PUT /identity/v3/projects/97014d2ffa604a69b2ff62ac31c01194/users/6fed0d624f044b24bd94d57fbe4d25bd/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:56.391151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d5e03-fafe-4f0e-8072-39be8952df86 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.391522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d5e03-fafe-4f0e-8072-39be8952df86 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.391801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d5e03-fafe-4f0e-8072-39be8952df86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.420369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0f6d5e03-fafe-4f0e-8072-39be8952df86 None None] MFA Rules not processed for user `6fed0d624f044b24bd94d57fbe4d25bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:56.421594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0f6d5e03-fafe-4f0e-8072-39be8952df86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:56.495492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1095/2164] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:56.500137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9780e38-5c7f-49ce-bd6c-b2b1d7031171 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.565450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9780e38-5c7f-49ce-bd6c-b2b1d7031171 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.570953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45926aef-8eee-4f4a-819b-e216c1cd9896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.571619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926aef-8eee-4f4a-819b-e216c1cd9896 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.571735 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d5e03-fafe-4f0e-8072-39be8952df86 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.571904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926aef-8eee-4f4a-819b-e216c1cd9896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.572197 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926aef-8eee-4f4a-819b-e216c1cd9896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.572937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45926aef-8eee-4f4a-819b-e216c1cd9896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.573456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0f6d5e03-fafe-4f0e-8072-39be8952df86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:56.575076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45926aef-8eee-4f4a-819b-e216c1cd9896 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.587962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d5e03-fafe-4f0e-8072-39be8952df86 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.593580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.594237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.594723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.594890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] PATH_INFO: `/v3/projects/ca2b6448e9194c57b626385dfff1dfbc` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.596099 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2b6448e9194c57b626385dfff1dfbc)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.598039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.611875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1070/2165] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:56.616224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45926aef-8eee-4f4a-819b-e216c1cd9896 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.663900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2b6448e9194c57b626385dfff1dfbc', 'request_id': 'req-28c739af-837c-4dd1-a9e1-9d6df9f1a943'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:56.677300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2b6448e9194c57b626385dfff1dfbc', 'request_id': 'req-28c739af-837c-4dd1-a9e1-9d6df9f1a943'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:56.687805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2b6448e9194c57b626385dfff1dfbc', 'request_id': 'req-28c739af-837c-4dd1-a9e1-9d6df9f1a943'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:56.705621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45926aef-8eee-4f4a-819b-e216c1cd9896 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.709664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] The token cache is being invalidate because project ca2b6448e9194c57b626385dfff1dfbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:56.710213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:56.711353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-28c739af-837c-4dd1-a9e1-9d6df9f1a943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:56.717591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1096/2166] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:56 2022] DELETE /identity/v3/projects/ca2b6448e9194c57b626385dfff1dfbc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:56.720163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aae72a-24af-460a-b288-c3e2080ecd88 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.720453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aae72a-24af-460a-b288-c3e2080ecd88 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.720730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aae72a-24af-460a-b288-c3e2080ecd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.731053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:56.731899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:56.751601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-30aae72a-24af-460a-b288-c3e2080ecd88 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:56.751601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-30aae72a-24af-460a-b288-c3e2080ecd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:56.783539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c43a-e993-47e1-899a-99664af12298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.784162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c43a-e993-47e1-899a-99664af12298 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.784437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c43a-e993-47e1-899a-99664af12298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.784706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c43a-e993-47e1-899a-99664af12298 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.785397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c43a-e993-47e1-899a-99664af12298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.787426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c43a-e993-47e1-899a-99664af12298 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.810425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1071/2167] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:56.813527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1097/2168] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:56.814345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c43a-e993-47e1-899a-99664af12298 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.816018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-efe0c43a-e993-47e1-899a-99664af12298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:56.821162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7183b0-ae03-463d-9e8b-11424d1f64e8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.821443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7183b0-ae03-463d-9e8b-11424d1f64e8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.821715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7183b0-ae03-463d-9e8b-11424d1f64e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.828529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c43a-e993-47e1-899a-99664af12298 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.833441 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc570eff-1f2b-4678-bd0a-13a7d77fa577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.834044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc570eff-1f2b-4678-bd0a-13a7d77fa577 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.834323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc570eff-1f2b-4678-bd0a-13a7d77fa577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.834597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc570eff-1f2b-4678-bd0a-13a7d77fa577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.835243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc570eff-1f2b-4678-bd0a-13a7d77fa577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.836949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc570eff-1f2b-4678-bd0a-13a7d77fa577 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.841362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ba7183b0-ae03-463d-9e8b-11424d1f64e8 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:56.842567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ba7183b0-ae03-463d-9e8b-11424d1f64e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:56.848253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1072/2169] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:56.854079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1098/2170] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:56.854222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc570eff-1f2b-4678-bd0a-13a7d77fa577 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.855156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7183b0-ae03-463d-9e8b-11424d1f64e8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.863792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc570eff-1f2b-4678-bd0a-13a7d77fa577 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.864864 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7183b0-ae03-463d-9e8b-11424d1f64e8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.868582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd532-8c0c-4401-8287-1d8c7f920e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.869178 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd532-8c0c-4401-8287-1d8c7f920e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.869508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd532-8c0c-4401-8287-1d8c7f920e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.869631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fc548-c627-4a15-93c6-50b854c47e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.870066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd532-8c0c-4401-8287-1d8c7f920e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.870162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fc548-c627-4a15-93c6-50b854c47e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.870393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fc548-c627-4a15-93c6-50b854c47e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.870494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dd532-8c0c-4401-8287-1d8c7f920e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.870661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fc548-c627-4a15-93c6-50b854c47e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.871371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fc548-c627-4a15-93c6-50b854c47e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:56.871676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fc548-c627-4a15-93c6-50b854c47e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.872152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dd532-8c0c-4401-8287-1d8c7f920e59 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.873402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fc548-c627-4a15-93c6-50b854c47e49 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.882701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1073/2171] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:56.886399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1099/2172] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:33:56.887182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd532-8c0c-4401-8287-1d8c7f920e59 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.893036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fc548-c627-4a15-93c6-50b854c47e49 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.898005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd532-8c0c-4401-8287-1d8c7f920e59 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.903087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd059f-0ac2-422c-9c0f-903fcfac0499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.903859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd059f-0ac2-422c-9c0f-903fcfac0499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.904119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fc548-c627-4a15-93c6-50b854c47e49 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:56.904260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd059f-0ac2-422c-9c0f-903fcfac0499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.904464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd059f-0ac2-422c-9c0f-903fcfac0499 admin admin] PATH_INFO: `/v3/projects/ca9f2c29e4e84797bdef4ff11ea7749a/users/e6ea47e75c43414ba1df737e8a829b7a/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.909620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b9d31-cd7f-4506-924b-dff525d0c6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:56.910224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b9d31-cd7f-4506-924b-dff525d0c6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.910495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b9d31-cd7f-4506-924b-dff525d0c6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.910759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b9d31-cd7f-4506-924b-dff525d0c6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.911419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b9d31-cd7f-4506-924b-dff525d0c6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.913375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b9d31-cd7f-4506-924b-dff525d0c6e5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.919874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd059f-0ac2-422c-9c0f-903fcfac0499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9f2c29e4e84797bdef4ff11ea7749a, user_id=e6ea47e75c43414ba1df737e8a829b7a, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:56.922675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd059f-0ac2-422c-9c0f-903fcfac0499 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:56.941201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1074/2173] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:56 2022] PUT /identity/v3/projects/ca9f2c29e4e84797bdef4ff11ea7749a/users/e6ea47e75c43414ba1df737e8a829b7a/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:56.949484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1100/2174] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:56.953049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd3022-7bb6-4874-9e0e-6f92dda52c47 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:56.953333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd3022-7bb6-4874-9e0e-6f92dda52c47 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:56.953608 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd3022-7bb6-4874-9e0e-6f92dda52c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:56.953967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b9d31-cd7f-4506-924b-dff525d0c6e5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:56.981843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c7dd3022-7bb6-4874-9e0e-6f92dda52c47 None None] MFA Rules not processed for user `e6ea47e75c43414ba1df737e8a829b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:56.983219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c7dd3022-7bb6-4874-9e0e-6f92dda52c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:57.019391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b9d31-cd7f-4506-924b-dff525d0c6e5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.024627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e7ad-4f7d-419a-8d95-3a71b75066e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.025373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e7ad-4f7d-419a-8d95-3a71b75066e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.025708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e7ad-4f7d-419a-8d95-3a71b75066e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.026041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e7ad-4f7d-419a-8d95-3a71b75066e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.026684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e7ad-4f7d-419a-8d95-3a71b75066e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.028806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e7ad-4f7d-419a-8d95-3a71b75066e5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.059659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1101/2175] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:57.060637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e7ad-4f7d-419a-8d95-3a71b75066e5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.062333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1075/2176] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:57.067232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd3022-7bb6-4874-9e0e-6f92dda52c47 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.078389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e7ad-4f7d-419a-8d95-3a71b75066e5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.084049 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd3022-7bb6-4874-9e0e-6f92dda52c47 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.084447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ac3e2-7f30-4f01-99a0-206165044ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.085068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ac3e2-7f30-4f01-99a0-206165044ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.085341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ac3e2-7f30-4f01-99a0-206165044ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.085606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ac3e2-7f30-4f01-99a0-206165044ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.086773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ac3e2-7f30-4f01-99a0-206165044ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.088707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ac3e2-7f30-4f01-99a0-206165044ecd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.098352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc457800-5859-48b9-877a-5e2528439a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.100143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc457800-5859-48b9-877a-5e2528439a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.100439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc457800-5859-48b9-877a-5e2528439a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.101039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc457800-5859-48b9-877a-5e2528439a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.101721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc457800-5859-48b9-877a-5e2528439a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.103624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1102/2177] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:57.103806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc457800-5859-48b9-877a-5e2528439a22 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.106069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ac3e2-7f30-4f01-99a0-206165044ecd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.117038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ac3e2-7f30-4f01-99a0-206165044ecd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.121748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141e13d-fb9f-4672-ae84-2e8548bbab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.122587 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141e13d-fb9f-4672-ae84-2e8548bbab79 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.122907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141e13d-fb9f-4672-ae84-2e8548bbab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.123169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141e13d-fb9f-4672-ae84-2e8548bbab79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.123869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141e13d-fb9f-4672-ae84-2e8548bbab79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.125458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141e13d-fb9f-4672-ae84-2e8548bbab79 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.140081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1103/2178] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:57.143811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1076/2179] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:57 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:57.144446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141e13d-fb9f-4672-ae84-2e8548bbab79 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.145699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc457800-5859-48b9-877a-5e2528439a22 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.155286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141e13d-fb9f-4672-ae84-2e8548bbab79 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.178796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:57.202612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:57.216479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc457800-5859-48b9-877a-5e2528439a22 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.221815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94996752-37ea-4871-90c8-943c251b4214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.222567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996752-37ea-4871-90c8-943c251b4214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.222909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996752-37ea-4871-90c8-943c251b4214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.223265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996752-37ea-4871-90c8-943c251b4214 admin admin] PATH_INFO: `/v3/projects/c7b74548d1414ba1a7034eb95bd804f9/users/049dc308f1064356b7c03de754e99610/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.237929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c61028-a89b-4835-9fec-138795f698c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.239034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61028-a89b-4835-9fec-138795f698c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.239348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61028-a89b-4835-9fec-138795f698c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.239601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61028-a89b-4835-9fec-138795f698c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.240345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c61028-a89b-4835-9fec-138795f698c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.242283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c61028-a89b-4835-9fec-138795f698c5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.245309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94996752-37ea-4871-90c8-943c251b4214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b74548d1414ba1a7034eb95bd804f9, user_id=049dc308f1064356b7c03de754e99610, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.248504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94996752-37ea-4871-90c8-943c251b4214 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.264745 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1077/2180] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:57 2022] PUT /identity/v3/projects/c7b74548d1414ba1a7034eb95bd804f9/users/049dc308f1064356b7c03de754e99610/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:57.267389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1104/2181] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:57 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:57.270275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94996752-37ea-4871-90c8-943c251b4214 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.275438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4cf5f-2f8a-4dee-831f-dec9062817c5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.275959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4cf5f-2f8a-4dee-831f-dec9062817c5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.276606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4cf5f-2f8a-4dee-831f-dec9062817c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.323272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ecf4cf5f-2f8a-4dee-831f-dec9062817c5 None None] MFA Rules not processed for user `049dc308f1064356b7c03de754e99610`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:57.324961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ecf4cf5f-2f8a-4dee-831f-dec9062817c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:57.372904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94996752-37ea-4871-90c8-943c251b4214 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.377862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6758e1-e03e-4dda-b2df-7c5c918f3667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.378462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6758e1-e03e-4dda-b2df-7c5c918f3667 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.378734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6758e1-e03e-4dda-b2df-7c5c918f3667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.378999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6758e1-e03e-4dda-b2df-7c5c918f3667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.379676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6758e1-e03e-4dda-b2df-7c5c918f3667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.381277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6758e1-e03e-4dda-b2df-7c5c918f3667 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.391204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1078/2182] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:57.395373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6758e1-e03e-4dda-b2df-7c5c918f3667 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.395755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1105/2183] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:57.400121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4cf5f-2f8a-4dee-831f-dec9062817c5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.404936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6758e1-e03e-4dda-b2df-7c5c918f3667 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.409514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecb95a-8d57-48ec-83fc-4333d2b6e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.410129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4cf5f-2f8a-4dee-831f-dec9062817c5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.410268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecb95a-8d57-48ec-83fc-4333d2b6e1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.410361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecb95a-8d57-48ec-83fc-4333d2b6e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.410668 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecb95a-8d57-48ec-83fc-4333d2b6e1d6 admin admin] PATH_INFO: `/v3/projects/1cb7eede679c477e9298d35e13ba36a4/users/a3cbb748b5804eeeaff59e28e798ed9e/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.414808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98873627-f3bd-4f88-9225-59e39c3bbd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.415593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98873627-f3bd-4f88-9225-59e39c3bbd2b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.415799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98873627-f3bd-4f88-9225-59e39c3bbd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.416062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98873627-f3bd-4f88-9225-59e39c3bbd2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.416703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98873627-f3bd-4f88-9225-59e39c3bbd2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.418873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98873627-f3bd-4f88-9225-59e39c3bbd2b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.427108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecb95a-8d57-48ec-83fc-4333d2b6e1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb7eede679c477e9298d35e13ba36a4, user_id=a3cbb748b5804eeeaff59e28e798ed9e, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.429974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecb95a-8d57-48ec-83fc-4333d2b6e1d6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.445774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1079/2184] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:57 2022] PUT /identity/v3/projects/1cb7eede679c477e9298d35e13ba36a4/users/a3cbb748b5804eeeaff59e28e798ed9e/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:57.449244 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1106/2185] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:57 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:57.449784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecb95a-8d57-48ec-83fc-4333d2b6e1d6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.453018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98873627-f3bd-4f88-9225-59e39c3bbd2b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.513373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecb95a-8d57-48ec-83fc-4333d2b6e1d6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.516707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98873627-f3bd-4f88-9225-59e39c3bbd2b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.518025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d3ed-b920-4b73-b2b1-8ffb6723973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.518629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d3ed-b920-4b73-b2b1-8ffb6723973d admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.518902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d3ed-b920-4b73-b2b1-8ffb6723973d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.519166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d3ed-b920-4b73-b2b1-8ffb6723973d admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.519839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d3ed-b920-4b73-b2b1-8ffb6723973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.521460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d3ed-b920-4b73-b2b1-8ffb6723973d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.521574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5e9fe-3bd9-467a-b058-d286faaef3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.522083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e9fe-3bd9-467a-b058-d286faaef3fb admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.522359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e9fe-3bd9-467a-b058-d286faaef3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.522635 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e9fe-3bd9-467a-b058-d286faaef3fb admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.523297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5e9fe-3bd9-467a-b058-d286faaef3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.525249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5e9fe-3bd9-467a-b058-d286faaef3fb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.531671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1080/2186] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:57.537025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d3ed-b920-4b73-b2b1-8ffb6723973d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.548095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d3ed-b920-4b73-b2b1-8ffb6723973d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.556622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1107/2187] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:57 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:57.556793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6121eb-3cca-4d74-b6a8-4cecb0396058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.556793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6121eb-3cca-4d74-b6a8-4cecb0396058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.557000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6121eb-3cca-4d74-b6a8-4cecb0396058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.557096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6121eb-3cca-4d74-b6a8-4cecb0396058 admin admin] PATH_INFO: `/v3/projects/1cb7eede679c477e9298d35e13ba36a4/users/a3cbb748b5804eeeaff59e28e798ed9e/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.558361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5e9fe-3bd9-467a-b058-d286faaef3fb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.559291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6121eb-3cca-4d74-b6a8-4cecb0396058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb7eede679c477e9298d35e13ba36a4, user_id=a3cbb748b5804eeeaff59e28e798ed9e, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.562093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6121eb-3cca-4d74-b6a8-4cecb0396058 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.569159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5e9fe-3bd9-467a-b058-d286faaef3fb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.582841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1081/2188] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:57 2022] PUT /identity/v3/projects/1cb7eede679c477e9298d35e13ba36a4/users/a3cbb748b5804eeeaff59e28e798ed9e/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:33:57.584676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38caba4-404e-4f6f-adf4-064541545faa None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.585016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38caba4-404e-4f6f-adf4-064541545faa None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.585294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38caba4-404e-4f6f-adf4-064541545faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.592953 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:57.597453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:57.621219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d38caba4-404e-4f6f-adf4-064541545faa None None] MFA Rules not processed for user `a3cbb748b5804eeeaff59e28e798ed9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:57.622555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d38caba4-404e-4f6f-adf4-064541545faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:57.646697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fe4ef-7318-4727-bf8d-c6341e6d0fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.647668 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe4ef-7318-4727-bf8d-c6341e6d0fae admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.647803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe4ef-7318-4727-bf8d-c6341e6d0fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.648035 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe4ef-7318-4727-bf8d-c6341e6d0fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.648713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fe4ef-7318-4727-bf8d-c6341e6d0fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.650322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fe4ef-7318-4727-bf8d-c6341e6d0fae admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.663364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1108/2189] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:33:57.668574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fe4ef-7318-4727-bf8d-c6341e6d0fae admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.680850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fe4ef-7318-4727-bf8d-c6341e6d0fae admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.686347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911c18c-351a-49f3-becf-fd52c75acd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.687044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c18c-351a-49f3-becf-fd52c75acd41 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.687475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c18c-351a-49f3-becf-fd52c75acd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.687888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c18c-351a-49f3-becf-fd52c75acd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.688672 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911c18c-351a-49f3-becf-fd52c75acd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.690717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911c18c-351a-49f3-becf-fd52c75acd41 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.702185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1082/2190] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:57.710957 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1109/2191] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:57.713160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38caba4-404e-4f6f-adf4-064541545faa None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.723490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911c18c-351a-49f3-becf-fd52c75acd41 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.725911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7911c18c-351a-49f3-becf-fd52c75acd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:57.733630 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38caba4-404e-4f6f-adf4-064541545faa None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.741198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3ef7f-abca-4552-8e18-da69ec0367f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.742107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ef7f-abca-4552-8e18-da69ec0367f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.742441 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ef7f-abca-4552-8e18-da69ec0367f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.742877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ef7f-abca-4552-8e18-da69ec0367f6 admin admin] PATH_INFO: `/v3/projects/406f9bab65524f9299f6569112949e7f/users/f11a05f2498e445f8db204ed267c23b3/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.759475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3ef7f-abca-4552-8e18-da69ec0367f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=406f9bab65524f9299f6569112949e7f, user_id=f11a05f2498e445f8db204ed267c23b3, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.762122 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3ef7f-abca-4552-8e18-da69ec0367f6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.776205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1083/2192] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:57 2022] PUT /identity/v3/projects/406f9bab65524f9299f6569112949e7f/users/f11a05f2498e445f8db204ed267c23b3/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:57.787851 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad65c-09a1-47ba-9401-12f886a7ab2e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.788243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad65c-09a1-47ba-9401-12f886a7ab2e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.788396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad65c-09a1-47ba-9401-12f886a7ab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.807512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911c18c-351a-49f3-becf-fd52c75acd41 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.818242 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0bdad65c-09a1-47ba-9401-12f886a7ab2e None None] MFA Rules not processed for user `f11a05f2498e445f8db204ed267c23b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:57.819495 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0bdad65c-09a1-47ba-9401-12f886a7ab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:57.883148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd3056-9c2a-411a-8511-ebcb5ec583cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.884205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd3056-9c2a-411a-8511-ebcb5ec583cb service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.884354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd3056-9c2a-411a-8511-ebcb5ec583cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.884511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd3056-9c2a-411a-8511-ebcb5ec583cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.887990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1084/2193] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:57.888835 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdad65c-09a1-47ba-9401-12f886a7ab2e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.890184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0bdad65c-09a1-47ba-9401-12f886a7ab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:57.956638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd3056-9c2a-411a-8511-ebcb5ec583cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.957969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd3056-9c2a-411a-8511-ebcb5ec583cb service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.960078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:57.966622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdad65c-09a1-47ba-9401-12f886a7ab2e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.968796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1110/2194] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:57.969622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd3056-9c2a-411a-8511-ebcb5ec583cb service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:57.972690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.973512 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.973782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.974052 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] PATH_INFO: `/v3/users/688df99f320f475d9590553727f5b43b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.975487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] RBAC: Authorizing `identity:delete_user(user_id=688df99f320f475d9590553727f5b43b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.977476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.980181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd3056-9c2a-411a-8511-ebcb5ec583cb service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:57.985915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d3b3b-9693-445f-a8cf-f85c75c70b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:57.986781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3b3b-9693-445f-a8cf-f85c75c70b98 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:57.987064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3b3b-9693-445f-a8cf-f85c75c70b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:57.987483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3b3b-9693-445f-a8cf-f85c75c70b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:57.988568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d3b3b-9693-445f-a8cf-f85c75c70b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:57.990737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d3b3b-9693-445f-a8cf-f85c75c70b98 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:57.999501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:58.039550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1111/2195] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:57 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:58.039550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d3b3b-9693-445f-a8cf-f85c75c70b98 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:58.039550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5a2d3b3b-9693-445f-a8cf-f85c75c70b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:58.054940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688df99f320f475d9590553727f5b43b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:58.055664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688df99f320f475d9590553727f5b43b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:58.069999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688df99f320f475d9590553727f5b43b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:58.083942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688df99f320f475d9590553727f5b43b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:58.091286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688df99f320f475d9590553727f5b43b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:58.097937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1085/2196] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:57 2022] DELETE /identity/v3/users/688df99f320f475d9590553727f5b43b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:58.098587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:58.100383 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:58.106024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d3b3b-9693-445f-a8cf-f85c75c70b98 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:58.164128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a90c8a-9360-4db0-b391-bb965db74dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:58.164874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a90c8a-9360-4db0-b391-bb965db74dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.165200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a90c8a-9360-4db0-b391-bb965db74dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.165473 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a90c8a-9360-4db0-b391-bb965db74dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.167512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57a90c8a-9360-4db0-b391-bb965db74dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:58.175769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228295a-1cd9-4d23-bd77-50efd03f352b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:58.183276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfeb21-0614-4dfd-b330-e83249922119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:58.183928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfeb21-0614-4dfd-b330-e83249922119 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.184204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfeb21-0614-4dfd-b330-e83249922119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.184475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfeb21-0614-4dfd-b330-e83249922119 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.185908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfeb21-0614-4dfd-b330-e83249922119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:58.187905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfeb21-0614-4dfd-b330-e83249922119 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:58.210947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1086/2197] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:58 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:58.212587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec0c54-b67d-4a84-a679-37b3b8aaf66d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.213113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec0c54-b67d-4a84-a679-37b3b8aaf66d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.213633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec0c54-b67d-4a84-a679-37b3b8aaf66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.235629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e0ec0c54-b67d-4a84-a679-37b3b8aaf66d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:58.237634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e0ec0c54-b67d-4a84-a679-37b3b8aaf66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:58.246486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1087/2198] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:58.247408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec0c54-b67d-4a84-a679-37b3b8aaf66d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:58.250311 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a90c8a-9360-4db0-b391-bb965db74dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:58.250580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a90c8a-9360-4db0-b391-bb965db74dd5 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:58.259077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec0c54-b67d-4a84-a679-37b3b8aaf66d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:58.261172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1112/2199] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:58.262045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a90c8a-9360-4db0-b391-bb965db74dd5 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:58.264387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f30b3-71d6-472e-afac-f97ed7655f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:58.264552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57a90c8a-9360-4db0-b391-bb965db74dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:58.264994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f30b3-71d6-472e-afac-f97ed7655f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.265269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f30b3-71d6-472e-afac-f97ed7655f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.265532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f30b3-71d6-472e-afac-f97ed7655f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.266184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f30b3-71d6-472e-afac-f97ed7655f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:58.267877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f30b3-71d6-472e-afac-f97ed7655f64 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:58.282555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1088/2200] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:58.287123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f30b3-71d6-472e-afac-f97ed7655f64 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:58.298438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f30b3-71d6-472e-afac-f97ed7655f64 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:58.316791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ee69d-6ca6-48a7-9be8-95ae13100df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:58.317479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ee69d-6ca6-48a7-9be8-95ae13100df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.317757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ee69d-6ca6-48a7-9be8-95ae13100df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.318025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ee69d-6ca6-48a7-9be8-95ae13100df7 admin admin] PATH_INFO: `/v3/projects/6e21ce04c14543efb3caf2179b97b322/users/c4890bedce8946d0bc7e59da02e9216a/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.334696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ee69d-6ca6-48a7-9be8-95ae13100df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e21ce04c14543efb3caf2179b97b322, user_id=c4890bedce8946d0bc7e59da02e9216a, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:58.337662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ee69d-6ca6-48a7-9be8-95ae13100df7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:58.342463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a90c8a-9360-4db0-b391-bb965db74dd5 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:58.346987 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167e95d-5c23-43e5-b044-5936347ff3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:58.347667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167e95d-5c23-43e5-b044-5936347ff3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.348012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167e95d-5c23-43e5-b044-5936347ff3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.348924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167e95d-5c23-43e5-b044-5936347ff3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.360389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167e95d-5c23-43e5-b044-5936347ff3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:58.361673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1089/2201] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:58 2022] PUT /identity/v3/projects/6e21ce04c14543efb3caf2179b97b322/users/c4890bedce8946d0bc7e59da02e9216a/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:58.364233 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167e95d-5c23-43e5-b044-5936347ff3c6 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:58.368301 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ee69d-6ca6-48a7-9be8-95ae13100df7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:58.370651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:58.378042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1113/2202] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:58.402309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:58.459042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ee69d-6ca6-48a7-9be8-95ae13100df7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:58.467028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54423c8-6be8-4cd8-a996-caad335e056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:58.468060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54423c8-6be8-4cd8-a996-caad335e056a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.468448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54423c8-6be8-4cd8-a996-caad335e056a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.468804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54423c8-6be8-4cd8-a996-caad335e056a admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.469918 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54423c8-6be8-4cd8-a996-caad335e056a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:58.472369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54423c8-6be8-4cd8-a996-caad335e056a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:58.494042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1090/2203] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:58.499255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167e95d-5c23-43e5-b044-5936347ff3c6 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:58.510229 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167e95d-5c23-43e5-b044-5936347ff3c6 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:58.515231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5afd5f-4544-424d-b0b3-37248c22d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:58.516093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5afd5f-4544-424d-b0b3-37248c22d342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.516439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5afd5f-4544-424d-b0b3-37248c22d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.516744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5afd5f-4544-424d-b0b3-37248c22d342 admin admin] PATH_INFO: `/v3/projects/6e21ce04c14543efb3caf2179b97b322/users/c4890bedce8946d0bc7e59da02e9216a/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.519273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5afd5f-4544-424d-b0b3-37248c22d342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e21ce04c14543efb3caf2179b97b322, user_id=c4890bedce8946d0bc7e59da02e9216a, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:58.522398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5afd5f-4544-424d-b0b3-37248c22d342 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:58.539493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1114/2204] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:33:58 2022] PUT /identity/v3/projects/6e21ce04c14543efb3caf2179b97b322/users/c4890bedce8946d0bc7e59da02e9216a/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:58.549427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57e37-13e4-4232-b9e8-e10d1c35ea9b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.549700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57e37-13e4-4232-b9e8-e10d1c35ea9b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.549966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57e37-13e4-4232-b9e8-e10d1c35ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.585592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-78f57e37-13e4-4232-b9e8-e10d1c35ea9b None None] MFA Rules not processed for user `c4890bedce8946d0bc7e59da02e9216a`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:58.586208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-78f57e37-13e4-4232-b9e8-e10d1c35ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:58.680341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1091/2205] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:58.693804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5afd5f-4544-424d-b0b3-37248c22d342 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:58.695956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1a5afd5f-4544-424d-b0b3-37248c22d342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:58.718497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57e37-13e4-4232-b9e8-e10d1c35ea9b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:58.720061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-78f57e37-13e4-4232-b9e8-e10d1c35ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:58.788015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5afd5f-4544-424d-b0b3-37248c22d342 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:58.791823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13ec5f-6d59-4bf8-99e3-af974afa9ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:58.792376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13ec5f-6d59-4bf8-99e3-af974afa9ccb service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.792652 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13ec5f-6d59-4bf8-99e3-af974afa9ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.792918 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13ec5f-6d59-4bf8-99e3-af974afa9ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.795034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ae13ec5f-6d59-4bf8-99e3-af974afa9ccb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:58.811612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57e37-13e4-4232-b9e8-e10d1c35ea9b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:58.816217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:58.816849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.817112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.817397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] PATH_INFO: `/v3/projects/941229a57b094a70a6feddb7cdfa8c58` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.818901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=941229a57b094a70a6feddb7cdfa8c58)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:58.821417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:58.857130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13ec5f-6d59-4bf8-99e3-af974afa9ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:58.858662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13ec5f-6d59-4bf8-99e3-af974afa9ccb service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:58.867346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:58.868226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1115/2206] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:33:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:33:58.870115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941229a57b094a70a6feddb7cdfa8c58', 'request_id': 'req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:58.880490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941229a57b094a70a6feddb7cdfa8c58', 'request_id': 'req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:58.886955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941229a57b094a70a6feddb7cdfa8c58', 'request_id': 'req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:58.898751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] The token cache is being invalidate because project 941229a57b094a70a6feddb7cdfa8c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:58.899041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:58.899769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:58.901301 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1092/2207] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:58 2022] DELETE /identity/v3/projects/941229a57b094a70a6feddb7cdfa8c58 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:58.905493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13ec5f-6d59-4bf8-99e3-af974afa9ccb service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:58.917066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13ec5f-6d59-4bf8-99e3-af974afa9ccb service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:58.976923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:58.977570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:58.977848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:58.978117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] PATH_INFO: `/v3/users/31c1d27f24d34ad6adc660f66bff4e63` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:58.979429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c1d27f24d34ad6adc660f66bff4e63)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:58.981528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:59.038315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:59.042212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c1d27f24d34ad6adc660f66bff4e63'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:59.052951 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c1d27f24d34ad6adc660f66bff4e63'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:59.065797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c1d27f24d34ad6adc660f66bff4e63'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:59.066484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c1d27f24d34ad6adc660f66bff4e63'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:59.073513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-efa19afa-e9dd-4ac8-be88-78551ef59074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c1d27f24d34ad6adc660f66bff4e63'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:59.079970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1116/2208] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:33:58 2022] DELETE /identity/v3/users/31c1d27f24d34ad6adc660f66bff4e63 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:59.446367 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:59.447901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:59.462555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79ae0-0577-4fd1-aa07-4a6c2e67af95 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:59.526300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:59.526944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:59.527221 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:59.527518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] PATH_INFO: `/v3/projects/16f0cd3ede114213ab8588062fe954bd` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:59.528909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f0cd3ede114213ab8588062fe954bd)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:59.530827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:59.581413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f0cd3ede114213ab8588062fe954bd', 'request_id': 'req-fc5f6a4c-2442-4953-a612-80163fe7e26c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:59.589720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f0cd3ede114213ab8588062fe954bd', 'request_id': 'req-fc5f6a4c-2442-4953-a612-80163fe7e26c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:59.595622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f0cd3ede114213ab8588062fe954bd', 'request_id': 'req-fc5f6a4c-2442-4953-a612-80163fe7e26c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:59.606710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] The token cache is being invalidate because project 16f0cd3ede114213ab8588062fe954bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:33:59.606978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:59.607754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc5f6a4c-2442-4953-a612-80163fe7e26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:33:59.609240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1093/2209] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:33:59 2022] DELETE /identity/v3/projects/16f0cd3ede114213ab8588062fe954bd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:33:59.615585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8a8dd-82b1-450d-bd43-4ca8b95c341e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:59.615869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8a8dd-82b1-450d-bd43-4ca8b95c341e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:59.616142 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8a8dd-82b1-450d-bd43-4ca8b95c341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:59.636246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-15e8a8dd-82b1-450d-bd43-4ca8b95c341e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:59.637593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-15e8a8dd-82b1-450d-bd43-4ca8b95c341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:59.702346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1117/2210] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:33:59.712449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958096f5-83b7-4fd3-bc4f-42d6112e9e70 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:59.712734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958096f5-83b7-4fd3-bc4f-42d6112e9e70 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:59.713006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958096f5-83b7-4fd3-bc4f-42d6112e9e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:59.733280 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-958096f5-83b7-4fd3-bc4f-42d6112e9e70 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:33:59.734476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-958096f5-83b7-4fd3-bc4f-42d6112e9e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:33:59.743775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1094/2211] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:33:59.748405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8a8dd-82b1-450d-bd43-4ca8b95c341e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:59.766742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8a8dd-82b1-450d-bd43-4ca8b95c341e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:59.772249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa53d7f-8688-433f-b20e-ae235de37aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:59.772877 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa53d7f-8688-433f-b20e-ae235de37aab admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:59.773180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa53d7f-8688-433f-b20e-ae235de37aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:59.773448 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa53d7f-8688-433f-b20e-ae235de37aab admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:59.774107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa53d7f-8688-433f-b20e-ae235de37aab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:33:59.774408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa53d7f-8688-433f-b20e-ae235de37aab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:59.776101 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa53d7f-8688-433f-b20e-ae235de37aab admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:59.789285 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1118/2212] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:33:59.793904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958096f5-83b7-4fd3-bc4f-42d6112e9e70 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:59.804042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958096f5-83b7-4fd3-bc4f-42d6112e9e70 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:59.809652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f558275-6129-411c-844d-16d006edc6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:59.810395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f558275-6129-411c-844d-16d006edc6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:59.810680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f558275-6129-411c-844d-16d006edc6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:59.810956 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f558275-6129-411c-844d-16d006edc6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:59.811662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f558275-6129-411c-844d-16d006edc6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:59.813546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f558275-6129-411c-844d-16d006edc6b1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:59.848548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1095/2213] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:33:59 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:33:59.850074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa53d7f-8688-433f-b20e-ae235de37aab admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:59.862091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa53d7f-8688-433f-b20e-ae235de37aab admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:59.926568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f03765-0b6d-4234-946f-3c09f6663db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:59.927226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03765-0b6d-4234-946f-3c09f6663db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:59.927524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03765-0b6d-4234-946f-3c09f6663db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:59.927837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03765-0b6d-4234-946f-3c09f6663db7 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:59.928475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f03765-0b6d-4234-946f-3c09f6663db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:59.930378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f03765-0b6d-4234-946f-3c09f6663db7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:59.957153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1119/2214] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:33:59 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:33:59.958907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f558275-6129-411c-844d-16d006edc6b1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:33:59.970130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f558275-6129-411c-844d-16d006edc6b1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:33:59.977074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1cac-c298-4baf-a0fd-540400c12fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:33:59.977774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1cac-c298-4baf-a0fd-540400c12fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:33:59.978045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1cac-c298-4baf-a0fd-540400c12fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:33:59.978307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1cac-c298-4baf-a0fd-540400c12fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:33:59.978983 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b1cac-c298-4baf-a0fd-540400c12fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:33:59.980625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b1cac-c298-4baf-a0fd-540400c12fdb admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:33:59.991908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1096/2215] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:33:59.996038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f03765-0b6d-4234-946f-3c09f6663db7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:00.007193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f03765-0b6d-4234-946f-3c09f6663db7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:00.012236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec47f2-8313-4b7f-8ecd-30917f48f31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:00.013056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec47f2-8313-4b7f-8ecd-30917f48f31d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:00.013401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec47f2-8313-4b7f-8ecd-30917f48f31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:00.013699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec47f2-8313-4b7f-8ecd-30917f48f31d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:00.014349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec47f2-8313-4b7f-8ecd-30917f48f31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:00.015972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec47f2-8313-4b7f-8ecd-30917f48f31d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:00.027325 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1120/2216] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:00.031845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1cac-c298-4baf-a0fd-540400c12fdb admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:00.041990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1cac-c298-4baf-a0fd-540400c12fdb admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:00.047681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2e0ad-dad4-4217-887a-8f241b23e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:00.048466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2e0ad-dad4-4217-887a-8f241b23e5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:00.048739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2e0ad-dad4-4217-887a-8f241b23e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:00.049036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2e0ad-dad4-4217-887a-8f241b23e5d1 admin admin] PATH_INFO: `/v3/projects/e618173f420448e4b344c01b32406aa1/users/6b1748388568483488ea7bdf76f797fd/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:00.066568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2e0ad-dad4-4217-887a-8f241b23e5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618173f420448e4b344c01b32406aa1, user_id=6b1748388568483488ea7bdf76f797fd, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:00.069231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2e0ad-dad4-4217-887a-8f241b23e5d1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:00.078857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:00.084137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1097/2217] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:00 2022] PUT /identity/v3/projects/e618173f420448e4b344c01b32406aa1/users/6b1748388568483488ea7bdf76f797fd/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:00.095801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f99f-ac19-4138-a8b0-9138647ba369 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:00.096083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f99f-ac19-4138-a8b0-9138647ba369 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:00.096354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f99f-ac19-4138-a8b0-9138647ba369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:00.124930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9bc4f99f-ac19-4138-a8b0-9138647ba369 None None] MFA Rules not processed for user `6b1748388568483488ea7bdf76f797fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:00.126376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9bc4f99f-ac19-4138-a8b0-9138647ba369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:00.141044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:00.206687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1121/2218] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:00.218823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2e0ad-dad4-4217-887a-8f241b23e5d1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:00.220815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-03b2e0ad-dad4-4217-887a-8f241b23e5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:00.280633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2e0ad-dad4-4217-887a-8f241b23e5d1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:00.284282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085b216-97bd-4f05-933b-2f60bd8185c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:00.284889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085b216-97bd-4f05-933b-2f60bd8185c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:00.285212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085b216-97bd-4f05-933b-2f60bd8185c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:00.285499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085b216-97bd-4f05-933b-2f60bd8185c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:00.295261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085b216-97bd-4f05-933b-2f60bd8185c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:00.296747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085b216-97bd-4f05-933b-2f60bd8185c7 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:00.328180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1098/2219] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:00.332664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f99f-ac19-4138-a8b0-9138647ba369 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:00.429463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f99f-ac19-4138-a8b0-9138647ba369 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:00.432106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085b216-97bd-4f05-933b-2f60bd8185c7 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:00.435552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:00.436393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:00.436961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:00.437436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] PATH_INFO: `/v3/users/6b1748388568483488ea7bdf76f797fd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:00.438873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1748388568483488ea7bdf76f797fd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:00.440744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:00.443020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085b216-97bd-4f05-933b-2f60bd8185c7 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:00.449513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944784dc-772d-4368-8490-9b2b8c740449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:00.450478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944784dc-772d-4368-8490-9b2b8c740449 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:00.450701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944784dc-772d-4368-8490-9b2b8c740449 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:00.451054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944784dc-772d-4368-8490-9b2b8c740449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:00.453326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-944784dc-772d-4368-8490-9b2b8c740449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:00.514547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1748388568483488ea7bdf76f797fd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:00.525814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1748388568483488ea7bdf76f797fd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:00.540937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1748388568483488ea7bdf76f797fd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:00.541809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1748388568483488ea7bdf76f797fd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:00.547637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944784dc-772d-4368-8490-9b2b8c740449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:00.550305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944784dc-772d-4368-8490-9b2b8c740449 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:00.557959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1748388568483488ea7bdf76f797fd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:00.566621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1099/2220] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:00.571025 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1122/2221] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:00 2022] DELETE /identity/v3/users/6b1748388568483488ea7bdf76f797fd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:00.579948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ed32-b994-4efd-b0bf-40308193cba1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:00.580689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ed32-b994-4efd-b0bf-40308193cba1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:00.581179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ed32-b994-4efd-b0bf-40308193cba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:00.603478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6d46ed32-b994-4efd-b0bf-40308193cba1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:00.605060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6d46ed32-b994-4efd-b0bf-40308193cba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:00.698859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1100/2222] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:00.709372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:00.710810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:00.769335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:00.804142 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9c314-5f16-4d40-8cb4-b3ab6fc81cd5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:00.808969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9f494-d7e7-416e-9a7f-580d130aa828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:00.810190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f494-d7e7-416e-9a7f-580d130aa828 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:00.810532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f494-d7e7-416e-9a7f-580d130aa828 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:00.810812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f494-d7e7-416e-9a7f-580d130aa828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:00.823585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9f494-d7e7-416e-9a7f-580d130aa828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:00.828060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9f494-d7e7-416e-9a7f-580d130aa828 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:00.842928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1123/2223] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:01.176484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46ed32-b994-4efd-b0bf-40308193cba1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:01.178076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6d46ed32-b994-4efd-b0bf-40308193cba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:01.191666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46ed32-b994-4efd-b0bf-40308193cba1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:01.197563 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:01.198213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.198485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.198748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] PATH_INFO: `/v3/projects/e618173f420448e4b344c01b32406aa1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.200880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e618173f420448e4b344c01b32406aa1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:01.202384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:01.264931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:01.277955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e618173f420448e4b344c01b32406aa1', 'request_id': 'req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:01.298051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e618173f420448e4b344c01b32406aa1', 'request_id': 'req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:01.324213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e618173f420448e4b344c01b32406aa1', 'request_id': 'req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:01.337537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] The token cache is being invalidate because project e618173f420448e4b344c01b32406aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:01.337828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:01.338484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b826b1f0-64ce-4a97-9bbe-bf3ca5e27913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:01.343395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1101/2224] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:01 2022] DELETE /identity/v3/projects/e618173f420448e4b344c01b32406aa1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:01.343586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9f494-d7e7-416e-9a7f-580d130aa828 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:01.345052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a7d9f494-d7e7-416e-9a7f-580d130aa828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:01.345227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ad3e6-924c-4226-869e-cbbdd4be0e66 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.345535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ad3e6-924c-4226-869e-cbbdd4be0e66 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.345809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ad3e6-924c-4226-869e-cbbdd4be0e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.367145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9f494-d7e7-416e-9a7f-580d130aa828 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:01.368256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6c0ad3e6-924c-4226-869e-cbbdd4be0e66 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:01.370158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6c0ad3e6-924c-4226-869e-cbbdd4be0e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:01.430570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:01.431291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.431662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.431989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] PATH_INFO: `/v3/users/6fed0d624f044b24bd94d57fbe4d25bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.433156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1102/2225] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:01.433271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fed0d624f044b24bd94d57fbe4d25bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:01.434100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ad3e6-924c-4226-869e-cbbdd4be0e66 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:01.435356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:01.440481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6c0ad3e6-924c-4226-869e-cbbdd4be0e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:01.486110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fed0d624f044b24bd94d57fbe4d25bd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:01.494257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fed0d624f044b24bd94d57fbe4d25bd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:01.499895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ad3e6-924c-4226-869e-cbbdd4be0e66 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:01.503514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb4a04-022c-475a-b391-25ac4084b5d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:01.504119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4a04-022c-475a-b391-25ac4084b5d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.504395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4a04-022c-475a-b391-25ac4084b5d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.504671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4a04-022c-475a-b391-25ac4084b5d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.506403 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0efb4a04-022c-475a-b391-25ac4084b5d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:01.507288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fed0d624f044b24bd94d57fbe4d25bd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:01.507983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fed0d624f044b24bd94d57fbe4d25bd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:01.514827 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60437476-0423-4ef2-b38d-d353cd762438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fed0d624f044b24bd94d57fbe4d25bd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:01.520783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1124/2226] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:01 2022] DELETE /identity/v3/users/6fed0d624f044b24bd94d57fbe4d25bd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:01.522128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff9020-9c80-48f5-8b87-25213454d2f9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.522408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff9020-9c80-48f5-8b87-25213454d2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.522676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff9020-9c80-48f5-8b87-25213454d2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.542040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-42ff9020-9c80-48f5-8b87-25213454d2f9 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:01.543249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-42ff9020-9c80-48f5-8b87-25213454d2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:01.573298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb4a04-022c-475a-b391-25ac4084b5d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:01.574741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb4a04-022c-475a-b391-25ac4084b5d2 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:01.584389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1103/2227] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:01.585747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db457f2-fc35-4965-87e6-9d3e7bd4b2c9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.586030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db457f2-fc35-4965-87e6-9d3e7bd4b2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.586296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db457f2-fc35-4965-87e6-9d3e7bd4b2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.593875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:01.608655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1125/2228] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:01.609863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff9020-9c80-48f5-8b87-25213454d2f9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:01.610883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0db457f2-fc35-4965-87e6-9d3e7bd4b2c9 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:01.612116 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0db457f2-fc35-4965-87e6-9d3e7bd4b2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:01.622600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1104/2229] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:01.624235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff9020-9c80-48f5-8b87-25213454d2f9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:01.632677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b907a-1717-4792-a970-08a2647a48fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:01.633130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db457f2-fc35-4965-87e6-9d3e7bd4b2c9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:01.633451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b907a-1717-4792-a970-08a2647a48fd admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.633792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b907a-1717-4792-a970-08a2647a48fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.634191 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b907a-1717-4792-a970-08a2647a48fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.634841 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b907a-1717-4792-a970-08a2647a48fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:34:01.634943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0db457f2-fc35-4965-87e6-9d3e7bd4b2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:01.635264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b907a-1717-4792-a970-08a2647a48fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:01.637468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b907a-1717-4792-a970-08a2647a48fd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:01.646567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:01.658565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1126/2230] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:34:01.659384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b907a-1717-4792-a970-08a2647a48fd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:01.670541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b907a-1717-4792-a970-08a2647a48fd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:01.676409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ce67c-bebc-40aa-88be-37703f74bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:01.677340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce67c-bebc-40aa-88be-37703f74bae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.677902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce67c-bebc-40aa-88be-37703f74bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.678312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce67c-bebc-40aa-88be-37703f74bae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.679104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ce67c-bebc-40aa-88be-37703f74bae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:01.681441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ce67c-bebc-40aa-88be-37703f74bae3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:01.720511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1127/2231] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:34:01 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:34:01.720867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db457f2-fc35-4965-87e6-9d3e7bd4b2c9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:01.722812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ce67c-bebc-40aa-88be-37703f74bae3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:01.780642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c6e59-cf90-4319-b3d8-9d66689f57c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:01.781355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6e59-cf90-4319-b3d8-9d66689f57c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.781629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6e59-cf90-4319-b3d8-9d66689f57c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.782009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6e59-cf90-4319-b3d8-9d66689f57c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.793617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ce67c-bebc-40aa-88be-37703f74bae3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:01.798939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646aabc2-f98a-419d-82dd-13913d7473d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:01.799389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aabc2-f98a-419d-82dd-13913d7473d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.799658 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aabc2-f98a-419d-82dd-13913d7473d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.799928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aabc2-f98a-419d-82dd-13913d7473d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.800603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646aabc2-f98a-419d-82dd-13913d7473d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:01.802717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646aabc2-f98a-419d-82dd-13913d7473d3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:01.833169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1128/2232] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:34:01 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:34:01.835420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646aabc2-f98a-419d-82dd-13913d7473d3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:01.846527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646aabc2-f98a-419d-82dd-13913d7473d3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:01.859177 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284840aa-a600-4c50-81f2-8f449ba4512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:01.860026 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284840aa-a600-4c50-81f2-8f449ba4512f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.860183 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284840aa-a600-4c50-81f2-8f449ba4512f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.860443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284840aa-a600-4c50-81f2-8f449ba4512f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.861092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284840aa-a600-4c50-81f2-8f449ba4512f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:01.862699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284840aa-a600-4c50-81f2-8f449ba4512f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:01.878684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1129/2233] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:01.880365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284840aa-a600-4c50-81f2-8f449ba4512f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:01.882723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c6e59-cf90-4319-b3d8-9d66689f57c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:01.885047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c6e59-cf90-4319-b3d8-9d66689f57c9 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:01.893247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284840aa-a600-4c50-81f2-8f449ba4512f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:01.899221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378c629-3d21-4dfa-8c5d-2108e9272add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:01.899881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378c629-3d21-4dfa-8c5d-2108e9272add admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.900160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378c629-3d21-4dfa-8c5d-2108e9272add admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.900475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378c629-3d21-4dfa-8c5d-2108e9272add admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.901128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378c629-3d21-4dfa-8c5d-2108e9272add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:01.902879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1105/2234] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:34:01.903000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378c629-3d21-4dfa-8c5d-2108e9272add admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:01.920505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1130/2235] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:34:01.922029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c6e59-cf90-4319-b3d8-9d66689f57c9 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:01.936339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c6e59-cf90-4319-b3d8-9d66689f57c9 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:01.941051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51911b6f-c6fd-4824-b8a9-7731a0b5cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:01.941721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51911b6f-c6fd-4824-b8a9-7731a0b5cd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.941996 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51911b6f-c6fd-4824-b8a9-7731a0b5cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.942262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51911b6f-c6fd-4824-b8a9-7731a0b5cd68 admin admin] PATH_INFO: `/v3/projects/c9ab4e450b95482bab2d02d051949fc3/users/fe0862d2f6694be5b4ef0d760a55d10d/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:01.961896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51911b6f-c6fd-4824-b8a9-7731a0b5cd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ab4e450b95482bab2d02d051949fc3, user_id=fe0862d2f6694be5b4ef0d760a55d10d, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:01.965189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51911b6f-c6fd-4824-b8a9-7731a0b5cd68 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:01.979494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1106/2236] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:01 2022] PUT /identity/v3/projects/c9ab4e450b95482bab2d02d051949fc3/users/fe0862d2f6694be5b4ef0d760a55d10d/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:01.985654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201441-5b49-4cbe-b282-b621ecc03ede None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:01.985959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201441-5b49-4cbe-b282-b621ecc03ede None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:01.986230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201441-5b49-4cbe-b282-b621ecc03ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:02.014438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-47201441-5b49-4cbe-b282-b621ecc03ede None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:02.015909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-47201441-5b49-4cbe-b282-b621ecc03ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:02.082191 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1131/2237] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:02.092303 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51911b6f-c6fd-4824-b8a9-7731a0b5cd68 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:02.094642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-51911b6f-c6fd-4824-b8a9-7731a0b5cd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:02.156062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51911b6f-c6fd-4824-b8a9-7731a0b5cd68 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:02.162249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269d59-80bf-4ffa-a91b-004304cd2021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:02.163612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269d59-80bf-4ffa-a91b-004304cd2021 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:02.163612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269d59-80bf-4ffa-a91b-004304cd2021 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:02.163862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269d59-80bf-4ffa-a91b-004304cd2021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:02.171469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:02.176066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61269d59-80bf-4ffa-a91b-004304cd2021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:02.178100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61269d59-80bf-4ffa-a91b-004304cd2021 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:02.189271 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1107/2238] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:02.289085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47201441-5b49-4cbe-b282-b621ecc03ede None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:02.290374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-47201441-5b49-4cbe-b282-b621ecc03ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:02.307386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47201441-5b49-4cbe-b282-b621ecc03ede None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:02.313312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:02.313984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:02.314260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:02.314529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] PATH_INFO: `/v3/projects/97014d2ffa604a69b2ff62ac31c01194` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:02.315708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97014d2ffa604a69b2ff62ac31c01194)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:02.317628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:02.355389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:02.376327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97014d2ffa604a69b2ff62ac31c01194', 'request_id': 'req-d5911a30-da3c-43e1-affb-65ab561d8c50'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:02.384814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97014d2ffa604a69b2ff62ac31c01194', 'request_id': 'req-d5911a30-da3c-43e1-affb-65ab561d8c50'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:02.390716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97014d2ffa604a69b2ff62ac31c01194', 'request_id': 'req-d5911a30-da3c-43e1-affb-65ab561d8c50'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:02.401848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] The token cache is being invalidate because project 97014d2ffa604a69b2ff62ac31c01194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:02.402130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:02.402773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5911a30-da3c-43e1-affb-65ab561d8c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:02.404508 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1132/2239] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:02 2022] DELETE /identity/v3/projects/97014d2ffa604a69b2ff62ac31c01194 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:02.408681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269d59-80bf-4ffa-a91b-004304cd2021 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:02.418449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269d59-80bf-4ffa-a91b-004304cd2021 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:02.477324 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:02.478076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:02.478422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:02.478762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] PATH_INFO: `/v3/users/e6ea47e75c43414ba1df737e8a829b7a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:02.479950 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ea47e75c43414ba1df737e8a829b7a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:02.481971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:02.538153 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ea47e75c43414ba1df737e8a829b7a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:02.538981 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ea47e75c43414ba1df737e8a829b7a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:02.548212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ea47e75c43414ba1df737e8a829b7a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:02.563476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ea47e75c43414ba1df737e8a829b7a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:02.571565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fbd8fdd5-324a-4789-8a63-60dc62f4581d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ea47e75c43414ba1df737e8a829b7a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:02.584132 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1108/2240] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:02 2022] DELETE /identity/v3/users/e6ea47e75c43414ba1df737e8a829b7a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:02.885283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ac53-0aeb-4760-b90b-1ccb3bdadaa2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:02.885633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ac53-0aeb-4760-b90b-1ccb3bdadaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:02.885876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ac53-0aeb-4760-b90b-1ccb3bdadaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:02.889096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781205-e903-40d3-abe4-aead7cddbdf0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:02.889853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781205-e903-40d3-abe4-aead7cddbdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:02.890609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781205-e903-40d3-abe4-aead7cddbdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:02.923348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0b781205-e903-40d3-abe4-aead7cddbdf0 None None] MFA Rules not processed for user `38ad994421e24faa85d84691b53a6b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:02.925237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0b781205-e903-40d3-abe4-aead7cddbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:02.944041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a8a7ac53-0aeb-4760-b90b-1ccb3bdadaa2 None None] MFA Rules not processed for user `fe0862d2f6694be5b4ef0d760a55d10d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:02.945463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a8a7ac53-0aeb-4760-b90b-1ccb3bdadaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:03.011403 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1109/2241] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:34:03.012569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781205-e903-40d3-abe4-aead7cddbdf0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:03.014268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0b781205-e903-40d3-abe4-aead7cddbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:03.057365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:03.070876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1133/2242] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:03.089481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7ac53-0aeb-4760-b90b-1ccb3bdadaa2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:03.091349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a8a7ac53-0aeb-4760-b90b-1ccb3bdadaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:03.153712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781205-e903-40d3-abe4-aead7cddbdf0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:03.166873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:03.167584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:03.168460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:03.168460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] PATH_INFO: `/v3/projects/ca9f2c29e4e84797bdef4ff11ea7749a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:03.170638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9f2c29e4e84797bdef4ff11ea7749a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:03.173954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:03.230185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7ac53-0aeb-4760-b90b-1ccb3bdadaa2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:03.234502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdb1c3-4571-4da2-92b4-2efa1b3c67d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:03.235291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdb1c3-4571-4da2-92b4-2efa1b3c67d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:03.235725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdb1c3-4571-4da2-92b4-2efa1b3c67d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:03.235983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdb1c3-4571-4da2-92b4-2efa1b3c67d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:03.246743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdb1c3-4571-4da2-92b4-2efa1b3c67d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:03.249155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdb1c3-4571-4da2-92b4-2efa1b3c67d1 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:03.255033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9f2c29e4e84797bdef4ff11ea7749a', 'request_id': 'req-9ae507b9-6641-487e-9d3d-2b9c107f12ad'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:03.262396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1134/2243] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:03.264772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9f2c29e4e84797bdef4ff11ea7749a', 'request_id': 'req-9ae507b9-6641-487e-9d3d-2b9c107f12ad'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:03.271207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9f2c29e4e84797bdef4ff11ea7749a', 'request_id': 'req-9ae507b9-6641-487e-9d3d-2b9c107f12ad'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:03.285304 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] The token cache is being invalidate because project ca9f2c29e4e84797bdef4ff11ea7749a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:03.285304 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:03.286502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:03.288282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1110/2244] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:03 2022] DELETE /identity/v3/projects/ca9f2c29e4e84797bdef4ff11ea7749a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:03.292149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdb1c3-4571-4da2-92b4-2efa1b3c67d1 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:03.308107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdb1c3-4571-4da2-92b4-2efa1b3c67d1 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:03.370329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:03.388165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:03.388914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:03.389281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:03.389616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] PATH_INFO: `/v3/users/a3cbb748b5804eeeaff59e28e798ed9e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:03.390903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cbb748b5804eeeaff59e28e798ed9e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:03.393119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:03.450477 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cbb748b5804eeeaff59e28e798ed9e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:03.460429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cbb748b5804eeeaff59e28e798ed9e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:03.474913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cbb748b5804eeeaff59e28e798ed9e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:03.475835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cbb748b5804eeeaff59e28e798ed9e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:03.483825 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68a01b89-543a-4a7a-aad8-81e07656ca44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cbb748b5804eeeaff59e28e798ed9e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:03.491834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1135/2245] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:03 2022] DELETE /identity/v3/users/a3cbb748b5804eeeaff59e28e798ed9e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:04.153274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:04.155145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:04.185371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae507b9-6641-487e-9d3d-2b9c107f12ad admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:04.249419 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:04.250179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.250552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.250917 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] PATH_INFO: `/v3/projects/1cb7eede679c477e9298d35e13ba36a4` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.252198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb7eede679c477e9298d35e13ba36a4)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:04.254164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:04.329361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb7eede679c477e9298d35e13ba36a4', 'request_id': 'req-f97d3341-34d5-4735-96bb-ff9ca4bffd06'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:04.331336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:04.339717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb7eede679c477e9298d35e13ba36a4', 'request_id': 'req-f97d3341-34d5-4735-96bb-ff9ca4bffd06'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:04.348430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb7eede679c477e9298d35e13ba36a4', 'request_id': 'req-f97d3341-34d5-4735-96bb-ff9ca4bffd06'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:04.361426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] The token cache is being invalidate because project 1cb7eede679c477e9298d35e13ba36a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:04.362037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:04.362867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f97d3341-34d5-4735-96bb-ff9ca4bffd06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:04.365075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1111/2246] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:04 2022] DELETE /identity/v3/projects/1cb7eede679c477e9298d35e13ba36a4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:04.371528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9dd82-9371-4de1-89f3-0081b4f7a242 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.372069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9dd82-9371-4de1-89f3-0081b4f7a242 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.372174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9dd82-9371-4de1-89f3-0081b4f7a242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.393879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c2e9dd82-9371-4de1-89f3-0081b4f7a242 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:04.396464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c2e9dd82-9371-4de1-89f3-0081b4f7a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:04.475378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1136/2247] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:04.481865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9497ef4-7ea3-4475-bb4f-64d0ed9fa6d0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.482148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9497ef4-7ea3-4475-bb4f-64d0ed9fa6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.482420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9497ef4-7ea3-4475-bb4f-64d0ed9fa6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.513642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e9497ef4-7ea3-4475-bb4f-64d0ed9fa6d0 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:04.514957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e9497ef4-7ea3-4475-bb4f-64d0ed9fa6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:04.529699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1112/2248] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:04.531046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9dd82-9371-4de1-89f3-0081b4f7a242 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:04.546747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9dd82-9371-4de1-89f3-0081b4f7a242 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:04.551597 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b519f2-b10f-4f48-88d5-08db27914328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:04.552400 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b519f2-b10f-4f48-88d5-08db27914328 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.552679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b519f2-b10f-4f48-88d5-08db27914328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.552952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b519f2-b10f-4f48-88d5-08db27914328 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.553605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b519f2-b10f-4f48-88d5-08db27914328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:34:04.553906 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b519f2-b10f-4f48-88d5-08db27914328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:04.555529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b519f2-b10f-4f48-88d5-08db27914328 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:04.568849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1137/2249] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:34:04.573561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9497ef4-7ea3-4475-bb4f-64d0ed9fa6d0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:04.584256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9497ef4-7ea3-4475-bb4f-64d0ed9fa6d0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:04.589714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856e168-d1f0-4147-91c9-d2d3f806f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:04.590357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856e168-d1f0-4147-91c9-d2d3f806f670 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.590633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856e168-d1f0-4147-91c9-d2d3f806f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.590933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856e168-d1f0-4147-91c9-d2d3f806f670 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.591682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856e168-d1f0-4147-91c9-d2d3f806f670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:04.593657 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856e168-d1f0-4147-91c9-d2d3f806f670 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:04.642075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1113/2250] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:34:04 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:34:04.643203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b519f2-b10f-4f48-88d5-08db27914328 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:04.655516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b519f2-b10f-4f48-88d5-08db27914328 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:04.695546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c1de6-eccf-4b81-bc60-4ecce85cf815 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.695833 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c1de6-eccf-4b81-bc60-4ecce85cf815 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.696130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c1de6-eccf-4b81-bc60-4ecce85cf815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.719102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3e5c1de6-eccf-4b81-bc60-4ecce85cf815 None None] MFA Rules not processed for user `fe0862d2f6694be5b4ef0d760a55d10d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:04.720582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3e5c1de6-eccf-4b81-bc60-4ecce85cf815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:04.740556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:04.751794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03131ed-fbe0-4bfb-add0-60040fe16d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:04.752434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03131ed-fbe0-4bfb-add0-60040fe16d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.752947 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03131ed-fbe0-4bfb-add0-60040fe16d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.754053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03131ed-fbe0-4bfb-add0-60040fe16d6d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.755339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03131ed-fbe0-4bfb-add0-60040fe16d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:04.757922 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03131ed-fbe0-4bfb-add0-60040fe16d6d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:04.784691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1114/2251] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:04.785002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1138/2252] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:34:04 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:34:04.789542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c1de6-eccf-4b81-bc60-4ecce85cf815 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:04.801017 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c1de6-eccf-4b81-bc60-4ecce85cf815 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:04.805714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e9f9d-1959-4c06-b535-ee4808ecf171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:04.806402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9f9d-1959-4c06-b535-ee4808ecf171 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.806804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9f9d-1959-4c06-b535-ee4808ecf171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.807099 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9f9d-1959-4c06-b535-ee4808ecf171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.807880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e9f9d-1959-4c06-b535-ee4808ecf171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:04.809908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e9f9d-1959-4c06-b535-ee4808ecf171 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:04.820752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1115/2253] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:04.824688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03131ed-fbe0-4bfb-add0-60040fe16d6d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:04.836247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03131ed-fbe0-4bfb-add0-60040fe16d6d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:04.842738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c9db9-35e4-46a9-b789-a567f06a2dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:04.842850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9db9-35e4-46a9-b789-a567f06a2dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.843127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9db9-35e4-46a9-b789-a567f06a2dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.843471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9db9-35e4-46a9-b789-a567f06a2dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.844087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c9db9-35e4-46a9-b789-a567f06a2dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:04.845671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c9db9-35e4-46a9-b789-a567f06a2dd5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:04.861900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1139/2254] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:34:04.863617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e9f9d-1959-4c06-b535-ee4808ecf171 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:04.877336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e9f9d-1959-4c06-b535-ee4808ecf171 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:04.885565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28eb7b-dbce-45c9-bf18-d2f8433e9ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:04.886426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28eb7b-dbce-45c9-bf18-d2f8433e9ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.886711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28eb7b-dbce-45c9-bf18-d2f8433e9ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.887029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28eb7b-dbce-45c9-bf18-d2f8433e9ff3 admin admin] PATH_INFO: `/v3/projects/69094613cf0b4c9aac922a30b14e9429/users/e483bf2dd72a4f5aa8900585ae0fd107/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.905629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28eb7b-dbce-45c9-bf18-d2f8433e9ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69094613cf0b4c9aac922a30b14e9429, user_id=e483bf2dd72a4f5aa8900585ae0fd107, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:04.909039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28eb7b-dbce-45c9-bf18-d2f8433e9ff3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:04.925606 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1116/2255] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:04 2022] PUT /identity/v3/projects/69094613cf0b4c9aac922a30b14e9429/users/e483bf2dd72a4f5aa8900585ae0fd107/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:04.938096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704733fb-f444-4399-a8fb-d654c3601571 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:04.938419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704733fb-f444-4399-a8fb-d654c3601571 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:04.938914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704733fb-f444-4399-a8fb-d654c3601571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:04.969389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-704733fb-f444-4399-a8fb-d654c3601571 None None] MFA Rules not processed for user `e483bf2dd72a4f5aa8900585ae0fd107`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:04.971573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-704733fb-f444-4399-a8fb-d654c3601571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:05.055725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1140/2256] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:05.060589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28eb7b-dbce-45c9-bf18-d2f8433e9ff3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:05.132514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28eb7b-dbce-45c9-bf18-d2f8433e9ff3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:05.138109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a1233-65c3-4e39-ab34-33a79c843b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:05.138733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a1233-65c3-4e39-ab34-33a79c843b35 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:05.139007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a1233-65c3-4e39-ab34-33a79c843b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:05.139275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a1233-65c3-4e39-ab34-33a79c843b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:05.139936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a1233-65c3-4e39-ab34-33a79c843b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:05.141836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a1233-65c3-4e39-ab34-33a79c843b35 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:05.174483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1117/2257] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:34:05 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:34:05.176384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704733fb-f444-4399-a8fb-d654c3601571 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:05.187837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704733fb-f444-4399-a8fb-d654c3601571 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:05.252412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f7a94-f573-435f-815c-5a375a4e4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:05.253038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7a94-f573-435f-815c-5a375a4e4c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:05.253312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7a94-f573-435f-815c-5a375a4e4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:05.253582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7a94-f573-435f-815c-5a375a4e4c90 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:05.254216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f7a94-f573-435f-815c-5a375a4e4c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:05.256208 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f7a94-f573-435f-815c-5a375a4e4c90 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:05.281068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1141/2258] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:34:05 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:34:05.285191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a1233-65c3-4e39-ab34-33a79c843b35 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:05.292485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:05.296125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a1233-65c3-4e39-ab34-33a79c843b35 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:05.302742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c800a-3eb9-41cb-be82-bf454508fd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:05.303566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c800a-3eb9-41cb-be82-bf454508fd5b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:05.304160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c800a-3eb9-41cb-be82-bf454508fd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:05.304504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c800a-3eb9-41cb-be82-bf454508fd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:05.305390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c800a-3eb9-41cb-be82-bf454508fd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:05.307212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c800a-3eb9-41cb-be82-bf454508fd5b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:05.319497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1118/2259] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:05.322746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f7a94-f573-435f-815c-5a375a4e4c90 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:05.332876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f7a94-f573-435f-815c-5a375a4e4c90 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:05.337529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7c85-7ec6-4759-b2a5-49d1d464f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:05.338161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7c85-7ec6-4759-b2a5-49d1d464f99f admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:05.338441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7c85-7ec6-4759-b2a5-49d1d464f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:05.338716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7c85-7ec6-4759-b2a5-49d1d464f99f admin admin] PATH_INFO: `/v3/projects/38f643cde76f490b8797fdb9968b841d/users/290cb6bdb9654dbba8527ec6975685f2/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:05.354302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b7c85-7ec6-4759-b2a5-49d1d464f99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f643cde76f490b8797fdb9968b841d, user_id=290cb6bdb9654dbba8527ec6975685f2, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:05.357361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b7c85-7ec6-4759-b2a5-49d1d464f99f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:05.371726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1142/2260] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:05 2022] PUT /identity/v3/projects/38f643cde76f490b8797fdb9968b841d/users/290cb6bdb9654dbba8527ec6975685f2/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:34:05.375991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c800a-3eb9-41cb-be82-bf454508fd5b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:05.387137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c800a-3eb9-41cb-be82-bf454508fd5b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:05.464245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ce4d0-81d7-4cbd-a2a6-c2642cd7702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:05.464870 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce4d0-81d7-4cbd-a2a6-c2642cd7702a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:05.465150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce4d0-81d7-4cbd-a2a6-c2642cd7702a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:05.465425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce4d0-81d7-4cbd-a2a6-c2642cd7702a admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:05.466449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ce4d0-81d7-4cbd-a2a6-c2642cd7702a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:05.468299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ce4d0-81d7-4cbd-a2a6-c2642cd7702a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:05.480783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1119/2261] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:34:05.485288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7c85-7ec6-4759-b2a5-49d1d464f99f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:05.497465 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7c85-7ec6-4759-b2a5-49d1d464f99f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:05.504512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66393a-37ed-4b1d-84de-1dd2cec638c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:05.505215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66393a-37ed-4b1d-84de-1dd2cec638c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:05.505546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66393a-37ed-4b1d-84de-1dd2cec638c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:05.505865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66393a-37ed-4b1d-84de-1dd2cec638c0 admin admin] PATH_INFO: `/v3/projects/38f643cde76f490b8797fdb9968b841d/users/290cb6bdb9654dbba8527ec6975685f2/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:05.508260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66393a-37ed-4b1d-84de-1dd2cec638c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f643cde76f490b8797fdb9968b841d, user_id=290cb6bdb9654dbba8527ec6975685f2, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:05.511228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66393a-37ed-4b1d-84de-1dd2cec638c0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:05.524279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1143/2262] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:05 2022] PUT /identity/v3/projects/38f643cde76f490b8797fdb9968b841d/users/290cb6bdb9654dbba8527ec6975685f2/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:05.536131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3ba9-cff7-4785-994b-9cc6f038dd87 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:05.536424 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3ba9-cff7-4785-994b-9cc6f038dd87 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:05.536698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3ba9-cff7-4785-994b-9cc6f038dd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:05.569022 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-bafb3ba9-cff7-4785-994b-9cc6f038dd87 None None] MFA Rules not processed for user `290cb6bdb9654dbba8527ec6975685f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:05.570811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bafb3ba9-cff7-4785-994b-9cc6f038dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:05.658001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1120/2263] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:05.670169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66393a-37ed-4b1d-84de-1dd2cec638c0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:05.672266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9c66393a-37ed-4b1d-84de-1dd2cec638c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:05.694024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:05.758913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66393a-37ed-4b1d-84de-1dd2cec638c0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:05.761988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21188ad0-04d4-494f-8c94-65d7e1078efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:05.762759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21188ad0-04d4-494f-8c94-65d7e1078efd service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:05.763042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21188ad0-04d4-494f-8c94-65d7e1078efd service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:05.764132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21188ad0-04d4-494f-8c94-65d7e1078efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:05.787201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21188ad0-04d4-494f-8c94-65d7e1078efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:05.789132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21188ad0-04d4-494f-8c94-65d7e1078efd service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:05.814663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1144/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:34:05.834680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3ba9-cff7-4785-994b-9cc6f038dd87 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:05.837416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bafb3ba9-cff7-4785-994b-9cc6f038dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:05.972690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3ba9-cff7-4785-994b-9cc6f038dd87 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:05.978369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:05.979389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:05.979683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:05.980026 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] PATH_INFO: `/v3/users/049dc308f1064356b7c03de754e99610` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:05.981957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] RBAC: Authorizing `identity:delete_user(user_id=049dc308f1064356b7c03de754e99610)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:05.984362 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:06.017089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:06.059287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '049dc308f1064356b7c03de754e99610'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:06.059988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '049dc308f1064356b7c03de754e99610'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:06.072296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '049dc308f1064356b7c03de754e99610'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:06.086200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '049dc308f1064356b7c03de754e99610'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:06.101615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '049dc308f1064356b7c03de754e99610'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:06.109530 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1121/2265] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:05 2022] DELETE /identity/v3/users/049dc308f1064356b7c03de754e99610 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:06.114539 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff64da-6f9f-4854-ab76-62003347cedf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:06.114818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff64da-6f9f-4854-ab76-62003347cedf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:06.115082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff64da-6f9f-4854-ab76-62003347cedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:06.135932 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-38ff64da-6f9f-4854-ab76-62003347cedf None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:06.137083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-38ff64da-6f9f-4854-ab76-62003347cedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:06.214682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1145/2266] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:06.222312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:06.223896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:06.292861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994fb79-bd94-4aaf-9eb9-56f60fce888f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:06.298530 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294c850-f776-4563-8a94-e28c2f3caa6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:06.299287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294c850-f776-4563-8a94-e28c2f3caa6d service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:06.299585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294c850-f776-4563-8a94-e28c2f3caa6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:06.299898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294c850-f776-4563-8a94-e28c2f3caa6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:06.312185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294c850-f776-4563-8a94-e28c2f3caa6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:06.315429 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294c850-f776-4563-8a94-e28c2f3caa6d service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:06.328376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1122/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:06.603864 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff64da-6f9f-4854-ab76-62003347cedf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:06.606062 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-38ff64da-6f9f-4854-ab76-62003347cedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:06.648297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff64da-6f9f-4854-ab76-62003347cedf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:06.653341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:06.656185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:06.656471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:06.658889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] PATH_INFO: `/v3/users/e483bf2dd72a4f5aa8900585ae0fd107` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:06.660337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e483bf2dd72a4f5aa8900585ae0fd107)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:06.662275 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:06.717934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e483bf2dd72a4f5aa8900585ae0fd107'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:06.729816 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e483bf2dd72a4f5aa8900585ae0fd107'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:06.741028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e483bf2dd72a4f5aa8900585ae0fd107'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:06.741771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e483bf2dd72a4f5aa8900585ae0fd107'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:06.748830 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e483bf2dd72a4f5aa8900585ae0fd107'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:06.754800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1146/2268] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:06 2022] DELETE /identity/v3/users/e483bf2dd72a4f5aa8900585ae0fd107 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:06.760075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5ac8d-cd94-4978-ada8-6b8a46b2d1c3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:06.760571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5ac8d-cd94-4978-ada8-6b8a46b2d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:06.760662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5ac8d-cd94-4978-ada8-6b8a46b2d1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:06.781220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-50a5ac8d-cd94-4978-ada8-6b8a46b2d1c3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:06.782440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-50a5ac8d-cd94-4978-ada8-6b8a46b2d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:06.846164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1123/2269] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:06.857033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:06.858628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:06.893081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:06.922035 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aee5f7-af98-488c-9652-e81c1c86af6a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:06.928518 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3cc2b-8b17-47b3-a3c9-f32f814a0a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:06.929224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3cc2b-8b17-47b3-a3c9-f32f814a0a07 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:06.929504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3cc2b-8b17-47b3-a3c9-f32f814a0a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:06.929768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3cc2b-8b17-47b3-a3c9-f32f814a0a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:06.940821 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3cc2b-8b17-47b3-a3c9-f32f814a0a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:06.942683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3cc2b-8b17-47b3-a3c9-f32f814a0a07 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:06.954624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1147/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:06.959749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5ac8d-cd94-4978-ada8-6b8a46b2d1c3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:06.961318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-50a5ac8d-cd94-4978-ada8-6b8a46b2d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:06.973942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5ac8d-cd94-4978-ada8-6b8a46b2d1c3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:06.978960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:06.979638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:06.980010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:06.980175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] PATH_INFO: `/v3/projects/c7b74548d1414ba1a7034eb95bd804f9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:06.981514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b74548d1414ba1a7034eb95bd804f9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:06.983388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:07.037986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:07.063284 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b74548d1414ba1a7034eb95bd804f9', 'request_id': 'req-4ce98fd6-d252-4fea-824c-8d19540cfd17'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.093645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b74548d1414ba1a7034eb95bd804f9', 'request_id': 'req-4ce98fd6-d252-4fea-824c-8d19540cfd17'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.106176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b74548d1414ba1a7034eb95bd804f9', 'request_id': 'req-4ce98fd6-d252-4fea-824c-8d19540cfd17'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.123921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] The token cache is being invalidate because project c7b74548d1414ba1a7034eb95bd804f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:07.124344 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.125067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.126739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1124/2271] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:06 2022] DELETE /identity/v3/projects/c7b74548d1414ba1a7034eb95bd804f9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:07.131514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3cc2b-8b17-47b3-a3c9-f32f814a0a07 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:07.145364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3cc2b-8b17-47b3-a3c9-f32f814a0a07 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:07.225715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:07.226677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:07.227226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:07.227881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] PATH_INFO: `/v3/users/f11a05f2498e445f8db204ed267c23b3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:07.229727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11a05f2498e445f8db204ed267c23b3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:07.232171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:07.333391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11a05f2498e445f8db204ed267c23b3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.344395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11a05f2498e445f8db204ed267c23b3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.375348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11a05f2498e445f8db204ed267c23b3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.376314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11a05f2498e445f8db204ed267c23b3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.386465 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11a05f2498e445f8db204ed267c23b3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.407885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1148/2272] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:07 2022] DELETE /identity/v3/users/f11a05f2498e445f8db204ed267c23b3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:07.438459 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:07.439963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:07.453148 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98fd6-d252-4fea-824c-8d19540cfd17 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:07.546054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:07.547101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:07.547418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:07.547686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] PATH_INFO: `/v3/projects/69094613cf0b4c9aac922a30b14e9429` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:07.549495 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] RBAC: Authorizing `identity:delete_project(project_id=69094613cf0b4c9aac922a30b14e9429)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:07.551533 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:07.627299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69094613cf0b4c9aac922a30b14e9429', 'request_id': 'req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.640740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69094613cf0b4c9aac922a30b14e9429', 'request_id': 'req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.652381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69094613cf0b4c9aac922a30b14e9429', 'request_id': 'req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.668585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] The token cache is being invalidate because project 69094613cf0b4c9aac922a30b14e9429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:07.669052 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.670232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.673394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1125/2273] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:07 2022] DELETE /identity/v3/projects/69094613cf0b4c9aac922a30b14e9429 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:07.677592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:07.679342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:07.719107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6451a2-dbc4-421a-aa6e-c6ad009248c7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:07.797559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:07.820468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:07.821442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:07.821442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:07.821862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] PATH_INFO: `/v3/users/290cb6bdb9654dbba8527ec6975685f2` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:07.823363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=290cb6bdb9654dbba8527ec6975685f2)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:07.825405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:07.903921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:07.906615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:07.931719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd66d57-e7b3-4d64-aad0-0de84f06b66e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:07.943801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:07.952253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:07.953321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:07.953895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] PATH_INFO: `/v3/projects/406f9bab65524f9299f6569112949e7f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:07.956418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=406f9bab65524f9299f6569112949e7f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:07.960602 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:07.960963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290cb6bdb9654dbba8527ec6975685f2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.974171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290cb6bdb9654dbba8527ec6975685f2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.988962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290cb6bdb9654dbba8527ec6975685f2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.989762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290cb6bdb9654dbba8527ec6975685f2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:07.998207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290cb6bdb9654dbba8527ec6975685f2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.005740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1149/2274] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:07 2022] DELETE /identity/v3/users/290cb6bdb9654dbba8527ec6975685f2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:08.029001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:08.033244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406f9bab65524f9299f6569112949e7f', 'request_id': 'req-87249968-d373-4051-8e11-8b05641ee937'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.051340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406f9bab65524f9299f6569112949e7f', 'request_id': 'req-87249968-d373-4051-8e11-8b05641ee937'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.058765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406f9bab65524f9299f6569112949e7f', 'request_id': 'req-87249968-d373-4051-8e11-8b05641ee937'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.073009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] The token cache is being invalidate because project 406f9bab65524f9299f6569112949e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:08.073359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.073995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.076821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1126/2275] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:07 2022] DELETE /identity/v3/projects/406f9bab65524f9299f6569112949e7f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:08.081108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:08.083608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:08.157427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8602bc-6474-4fb8-9e1e-38d9b27ffc60 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:08.229171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:08.229818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.230103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.230363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] PATH_INFO: `/v3/users/c4890bedce8946d0bc7e59da02e9216a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.231630 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4890bedce8946d0bc7e59da02e9216a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:08.233555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:08.261057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:08.297746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4890bedce8946d0bc7e59da02e9216a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.306693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:08.308360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:08.323889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4890bedce8946d0bc7e59da02e9216a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.331420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87249968-d373-4051-8e11-8b05641ee937 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:08.338673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:08.340804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.341263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.341534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] PATH_INFO: `/v3/projects/38f643cde76f490b8797fdb9968b841d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.342771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f643cde76f490b8797fdb9968b841d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:08.344781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:08.347740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4890bedce8946d0bc7e59da02e9216a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.348583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4890bedce8946d0bc7e59da02e9216a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.356560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-11505363-bd2d-4537-8044-08a337913fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4890bedce8946d0bc7e59da02e9216a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.364781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1150/2276] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:08 2022] DELETE /identity/v3/users/c4890bedce8946d0bc7e59da02e9216a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:08.431269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f643cde76f490b8797fdb9968b841d', 'request_id': 'req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.443490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f643cde76f490b8797fdb9968b841d', 'request_id': 'req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.450709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f643cde76f490b8797fdb9968b841d', 'request_id': 'req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.467627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] The token cache is being invalidate because project 38f643cde76f490b8797fdb9968b841d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:08.468053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.468912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-af5bad0b-f6b4-44d6-acc6-d3e1ccfd7e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.471356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1127/2277] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:08 2022] DELETE /identity/v3/projects/38f643cde76f490b8797fdb9968b841d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:34:08.476795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec614db-ccbd-4d78-9226-9f6922a9e906 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.476795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec614db-ccbd-4d78-9226-9f6922a9e906 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.477036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec614db-ccbd-4d78-9226-9f6922a9e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.517671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4ec614db-ccbd-4d78-9226-9f6922a9e906 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:08.519013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4ec614db-ccbd-4d78-9226-9f6922a9e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:08.590674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1151/2278] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:08.598483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92f9e0-2a86-4d55-853c-0ffa889a8c34 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.598763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92f9e0-2a86-4d55-853c-0ffa889a8c34 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.599093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92f9e0-2a86-4d55-853c-0ffa889a8c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.620796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ef92f9e0-2a86-4d55-853c-0ffa889a8c34 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:08.622233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ef92f9e0-2a86-4d55-853c-0ffa889a8c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:08.630815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1128/2279] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:08.635397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec614db-ccbd-4d78-9226-9f6922a9e906 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:08.651247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec614db-ccbd-4d78-9226-9f6922a9e906 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:08.658188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e69658-748d-4f10-b2f6-5d51e0a7da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:08.658740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e69658-748d-4f10-b2f6-5d51e0a7da39 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.659113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e69658-748d-4f10-b2f6-5d51e0a7da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.659283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e69658-748d-4f10-b2f6-5d51e0a7da39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.660066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e69658-748d-4f10-b2f6-5d51e0a7da39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:34:08.660234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e69658-748d-4f10-b2f6-5d51e0a7da39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:08.662024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e69658-748d-4f10-b2f6-5d51e0a7da39 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:08.680512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1152/2280] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:34:08.683114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92f9e0-2a86-4d55-853c-0ffa889a8c34 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:08.693185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92f9e0-2a86-4d55-853c-0ffa889a8c34 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:08.699241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c667f29-9d2f-4ead-a93e-e5e3331fa5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:08.700017 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c667f29-9d2f-4ead-a93e-e5e3331fa5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.701204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c667f29-9d2f-4ead-a93e-e5e3331fa5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.701473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c667f29-9d2f-4ead-a93e-e5e3331fa5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.702113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c667f29-9d2f-4ead-a93e-e5e3331fa5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:08.704600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c667f29-9d2f-4ead-a93e-e5e3331fa5b0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:08.735635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1129/2281] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:34:08 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:34:08.740515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e69658-748d-4f10-b2f6-5d51e0a7da39 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:08.751411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e69658-748d-4f10-b2f6-5d51e0a7da39 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:08.781893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c667f29-9d2f-4ead-a93e-e5e3331fa5b0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:08.784112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6c667f29-9d2f-4ead-a93e-e5e3331fa5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:08.825480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb51e2-b87e-4d70-82c9-b769bc64e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:08.826096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb51e2-b87e-4d70-82c9-b769bc64e465 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.826370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb51e2-b87e-4d70-82c9-b769bc64e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.826635 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb51e2-b87e-4d70-82c9-b769bc64e465 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.827268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb51e2-b87e-4d70-82c9-b769bc64e465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:08.829229 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb51e2-b87e-4d70-82c9-b769bc64e465 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:08.853925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c667f29-9d2f-4ead-a93e-e5e3331fa5b0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:08.854898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1153/2282] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:34:08 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:34:08.859641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb51e2-b87e-4d70-82c9-b769bc64e465 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:08.861001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:08.861718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.862456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.862456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] PATH_INFO: `/v3/projects/6e21ce04c14543efb3caf2179b97b322` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.864146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e21ce04c14543efb3caf2179b97b322)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:08.866597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:08.871691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb51e2-b87e-4d70-82c9-b769bc64e465 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:08.877780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c4203-a177-45c0-b018-19572544ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:08.878340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c4203-a177-45c0-b018-19572544ad39 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.878615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c4203-a177-45c0-b018-19572544ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.878880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c4203-a177-45c0-b018-19572544ad39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.879576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c4203-a177-45c0-b018-19572544ad39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:08.881189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c4203-a177-45c0-b018-19572544ad39 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:08.897551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1154/2283] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:08.902014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c4203-a177-45c0-b018-19572544ad39 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:08.907771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:08.908316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:08.914256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c4203-a177-45c0-b018-19572544ad39 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:08.926305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e21ce04c14543efb3caf2179b97b322', 'request_id': 'req-da07fe30-b28b-4ba4-b864-4fe7c325db6a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.936922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e21ce04c14543efb3caf2179b97b322', 'request_id': 'req-da07fe30-b28b-4ba4-b864-4fe7c325db6a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.949129 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e21ce04c14543efb3caf2179b97b322', 'request_id': 'req-da07fe30-b28b-4ba4-b864-4fe7c325db6a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.968065 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] The token cache is being invalidate because project 6e21ce04c14543efb3caf2179b97b322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:08.968366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.969596 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da07fe30-b28b-4ba4-b864-4fe7c325db6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:08.972438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1130/2284] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:08 2022] DELETE /identity/v3/projects/6e21ce04c14543efb3caf2179b97b322 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:08.976872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfabce-525d-4a3b-9667-87193b7b40ad None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.978294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfabce-525d-4a3b-9667-87193b7b40ad None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.978294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfabce-525d-4a3b-9667-87193b7b40ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.987488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db459f-3579-4402-b1d1-4723886b9c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:08.988881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db459f-3579-4402-b1d1-4723886b9c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:08.989278 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db459f-3579-4402-b1d1-4723886b9c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:08.989644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db459f-3579-4402-b1d1-4723886b9c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:08.990455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db459f-3579-4402-b1d1-4723886b9c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:08.992471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db459f-3579-4402-b1d1-4723886b9c59 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:09.003558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1155/2285] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:09.007941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db459f-3579-4402-b1d1-4723886b9c59 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:09.010739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d8db459f-3579-4402-b1d1-4723886b9c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:09.016051 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-06cfabce-525d-4a3b-9667-87193b7b40ad None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:09.017653 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-06cfabce-525d-4a3b-9667-87193b7b40ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:09.024645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db459f-3579-4402-b1d1-4723886b9c59 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:09.030052 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1131/2286] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:34:09.037570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3796394-bf54-4262-a7fb-fa9e2ff71286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:09.038075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da84ab2-b13a-4c9f-bfce-d2d77a80311f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.038365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da84ab2-b13a-4c9f-bfce-d2d77a80311f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.038544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3796394-bf54-4262-a7fb-fa9e2ff71286 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.038651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da84ab2-b13a-4c9f-bfce-d2d77a80311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.039442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3796394-bf54-4262-a7fb-fa9e2ff71286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.039571 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3796394-bf54-4262-a7fb-fa9e2ff71286 admin admin] PATH_INFO: `/v3/projects/3e7e5326bdc74ea987c0010a1b5d6673/users/44c3ea6bdfab4c47b8a58b754b47b63c/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.058596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3796394-bf54-4262-a7fb-fa9e2ff71286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7e5326bdc74ea987c0010a1b5d6673, user_id=44c3ea6bdfab4c47b8a58b754b47b63c, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:09.061813 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3796394-bf54-4262-a7fb-fa9e2ff71286 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:09.066413 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1da84ab2-b13a-4c9f-bfce-d2d77a80311f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:09.067901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1da84ab2-b13a-4c9f-bfce-d2d77a80311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:09.076969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1132/2287] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:34:09.079724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1156/2288] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:09 2022] PUT /identity/v3/projects/3e7e5326bdc74ea987c0010a1b5d6673/users/44c3ea6bdfab4c47b8a58b754b47b63c/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:34:09.081320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da84ab2-b13a-4c9f-bfce-d2d77a80311f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:09.090901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8a2a4-fcb7-45b8-a817-aad8bae4dd29 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.091507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8a2a4-fcb7-45b8-a817-aad8bae4dd29 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.091879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8a2a4-fcb7-45b8-a817-aad8bae4dd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.103511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da84ab2-b13a-4c9f-bfce-d2d77a80311f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:09.130364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dfa8a2a4-fcb7-45b8-a817-aad8bae4dd29 None None] MFA Rules not processed for user `44c3ea6bdfab4c47b8a58b754b47b63c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:09.131839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dfa8a2a4-fcb7-45b8-a817-aad8bae4dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:09.163885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163a38-0d90-4831-a9af-63fc166bee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:09.164597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163a38-0d90-4831-a9af-63fc166bee42 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.164972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163a38-0d90-4831-a9af-63fc166bee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.165367 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163a38-0d90-4831-a9af-63fc166bee42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.166114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a163a38-0d90-4831-a9af-63fc166bee42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:34:09.166677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a163a38-0d90-4831-a9af-63fc166bee42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:09.168417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a163a38-0d90-4831-a9af-63fc166bee42 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:09.191916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1133/2289] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:34:09.195434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163a38-0d90-4831-a9af-63fc166bee42 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:09.199756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1157/2290] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:09.206146 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163a38-0d90-4831-a9af-63fc166bee42 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:09.210502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f1101-2fe2-4092-931a-133b14dee097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:09.211133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f1101-2fe2-4092-931a-133b14dee097 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.211258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8a2a4-fcb7-45b8-a817-aad8bae4dd29 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:09.211439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f1101-2fe2-4092-931a-133b14dee097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.211707 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f1101-2fe2-4092-931a-133b14dee097 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.212326 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f1101-2fe2-4092-931a-133b14dee097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:09.213051 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dfa8a2a4-fcb7-45b8-a817-aad8bae4dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:09.214221 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f1101-2fe2-4092-931a-133b14dee097 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:09.243939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1134/2291] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:34:09 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:34:09.248351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f1101-2fe2-4092-931a-133b14dee097 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:09.272085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8a2a4-fcb7-45b8-a817-aad8bae4dd29 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:09.288689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:09.312798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f1101-2fe2-4092-931a-133b14dee097 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:09.317758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea69f6-9c9c-4f3a-8600-d37d01afa5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:09.318376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea69f6-9c9c-4f3a-8600-d37d01afa5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.318659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea69f6-9c9c-4f3a-8600-d37d01afa5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.318940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea69f6-9c9c-4f3a-8600-d37d01afa5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.319603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea69f6-9c9c-4f3a-8600-d37d01afa5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:09.321609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea69f6-9c9c-4f3a-8600-d37d01afa5b2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:09.323103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ba11f-1f92-4442-b2ff-c0ca5fd6e79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:09.323748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba11f-1f92-4442-b2ff-c0ca5fd6e79c service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.324022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba11f-1f92-4442-b2ff-c0ca5fd6e79c service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.324290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba11f-1f92-4442-b2ff-c0ca5fd6e79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.344155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1135/2292] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:34:09 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:34:09.348264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea69f6-9c9c-4f3a-8600-d37d01afa5b2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:09.358232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea69f6-9c9c-4f3a-8600-d37d01afa5b2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:09.362848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d84715-2d97-4348-a2f7-3ab314939844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:09.363838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d84715-2d97-4348-a2f7-3ab314939844 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.364109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d84715-2d97-4348-a2f7-3ab314939844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.364373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d84715-2d97-4348-a2f7-3ab314939844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.365001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d84715-2d97-4348-a2f7-3ab314939844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:09.366941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d84715-2d97-4348-a2f7-3ab314939844 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:09.368279 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:09.379927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1136/2293] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:34:09.382944 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ba11f-1f92-4442-b2ff-c0ca5fd6e79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:09.383094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d84715-2d97-4348-a2f7-3ab314939844 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:09.384481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ba11f-1f92-4442-b2ff-c0ca5fd6e79c service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:09.393248 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d84715-2d97-4348-a2f7-3ab314939844 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:09.393719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1158/2294] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:34:09.399746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7906b-f54f-4e97-960a-2ae89239180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:09.400351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7906b-f54f-4e97-960a-2ae89239180a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.400623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7906b-f54f-4e97-960a-2ae89239180a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.400890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7906b-f54f-4e97-960a-2ae89239180a admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.401532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7906b-f54f-4e97-960a-2ae89239180a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:09.403333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7906b-f54f-4e97-960a-2ae89239180a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:09.418628 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1137/2295] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:09.419735 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ba11f-1f92-4442-b2ff-c0ca5fd6e79c service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:09.430821 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ba11f-1f92-4442-b2ff-c0ca5fd6e79c service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:09.436666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbc1cf-0864-4f95-868f-15de69498c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:09.437334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbc1cf-0864-4f95-868f-15de69498c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.437642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbc1cf-0864-4f95-868f-15de69498c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.437916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbc1cf-0864-4f95-868f-15de69498c1e admin admin] PATH_INFO: `/v3/projects/ad5eb7e9c05f46338e45816313132c07/users/ebf791343bac4436a8e562db621e2209/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.453550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbc1cf-0864-4f95-868f-15de69498c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5eb7e9c05f46338e45816313132c07, user_id=ebf791343bac4436a8e562db621e2209, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:09.456294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbc1cf-0864-4f95-868f-15de69498c1e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:09.471124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1159/2296] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:09 2022] PUT /identity/v3/projects/ad5eb7e9c05f46338e45816313132c07/users/ebf791343bac4436a8e562db621e2209/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:34:09.482604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee3f0e-222e-4197-bf8c-25adff474412 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.483099 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee3f0e-222e-4197-bf8c-25adff474412 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.483483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee3f0e-222e-4197-bf8c-25adff474412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.512007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2aee3f0e-222e-4197-bf8c-25adff474412 None None] MFA Rules not processed for user `ebf791343bac4436a8e562db621e2209`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:09.513393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2aee3f0e-222e-4197-bf8c-25adff474412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:09.581053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1138/2297] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:09.593979 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbc1cf-0864-4f95-868f-15de69498c1e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:09.596230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-85bbc1cf-0864-4f95-868f-15de69498c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:09.661246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbc1cf-0864-4f95-868f-15de69498c1e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:09.665243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb26c1d-0b54-4a72-bd55-2500b8701426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:09.665863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb26c1d-0b54-4a72-bd55-2500b8701426 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:09.666139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb26c1d-0b54-4a72-bd55-2500b8701426 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:09.666521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb26c1d-0b54-4a72-bd55-2500b8701426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:09.677478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb26c1d-0b54-4a72-bd55-2500b8701426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:09.680071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb26c1d-0b54-4a72-bd55-2500b8701426 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:09.692837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1160/2298] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:19.577671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=39 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:19.694406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:23.159070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee3f0e-222e-4197-bf8c-25adff474412 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:23.231610 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee3f0e-222e-4197-bf8c-25adff474412 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:23.238882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:23.239550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:23.239831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:23.240133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] PATH_INFO: `/v3/users/44c3ea6bdfab4c47b8a58b754b47b63c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:23.241369 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c3ea6bdfab4c47b8a58b754b47b63c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:23.243348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:23.298813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c3ea6bdfab4c47b8a58b754b47b63c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:23.299480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c3ea6bdfab4c47b8a58b754b47b63c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:23.318116 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c3ea6bdfab4c47b8a58b754b47b63c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:23.332805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c3ea6bdfab4c47b8a58b754b47b63c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:23.340266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c3ea6bdfab4c47b8a58b754b47b63c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:23.346246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1139/2299] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:23 2022] DELETE /identity/v3/users/44c3ea6bdfab4c47b8a58b754b47b63c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:23.351719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0d381-82bc-4319-bd98-5302913dc621 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:23.352301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0d381-82bc-4319-bd98-5302913dc621 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:23.352645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0d381-82bc-4319-bd98-5302913dc621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:23.376743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a8d0d381-82bc-4319-bd98-5302913dc621 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:23.378045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a8d0d381-82bc-4319-bd98-5302913dc621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:23.442327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1161/2300] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:23.452469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:23.454169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:23.522254 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af993b-1140-462b-98f0-f783676d994f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:23.526511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a3de-384f-4156-b306-dc2a2a62a87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:23.527112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a3de-384f-4156-b306-dc2a2a62a87b service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:23.527420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a3de-384f-4156-b306-dc2a2a62a87b service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:23.527687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a3de-384f-4156-b306-dc2a2a62a87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:23.537430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5a3de-384f-4156-b306-dc2a2a62a87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:23.538897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5a3de-384f-4156-b306-dc2a2a62a87b service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:23.548423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1140/2301] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:23.975127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0d381-82bc-4319-bd98-5302913dc621 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:23.976674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a8d0d381-82bc-4319-bd98-5302913dc621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:23.990462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0d381-82bc-4319-bd98-5302913dc621 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:23.995607 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:23.996268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:23.996545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:23.996811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] PATH_INFO: `/v3/projects/3e7e5326bdc74ea987c0010a1b5d6673` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:23.998219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7e5326bdc74ea987c0010a1b5d6673)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:24.000476 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:24.067898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7e5326bdc74ea987c0010a1b5d6673', 'request_id': 'req-8756dd07-8419-4ad4-9bdb-4d9948f1c349'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:24.079456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7e5326bdc74ea987c0010a1b5d6673', 'request_id': 'req-8756dd07-8419-4ad4-9bdb-4d9948f1c349'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:24.087794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7e5326bdc74ea987c0010a1b5d6673', 'request_id': 'req-8756dd07-8419-4ad4-9bdb-4d9948f1c349'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:24.104813 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] The token cache is being invalidate because project 3e7e5326bdc74ea987c0010a1b5d6673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:24.105391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:24.106058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8756dd07-8419-4ad4-9bdb-4d9948f1c349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:24.111360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1162/2302] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:23 2022] DELETE /identity/v3/projects/3e7e5326bdc74ea987c0010a1b5d6673 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:24.114123 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4556791-3f4a-4d34-8f70-0510b97c1fd1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:24.114398 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4556791-3f4a-4d34-8f70-0510b97c1fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:24.114664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4556791-3f4a-4d34-8f70-0510b97c1fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:24.157444 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b4556791-3f4a-4d34-8f70-0510b97c1fd1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:24.158770 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b4556791-3f4a-4d34-8f70-0510b97c1fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:24.180415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:24.240359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1141/2303] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:24.242131 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dcf46-072b-4d19-aa89-235d80879e87 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:24.242412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dcf46-072b-4d19-aa89-235d80879e87 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:24.242695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dcf46-072b-4d19-aa89-235d80879e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:24.264155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c52dcf46-072b-4d19-aa89-235d80879e87 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:24.265377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c52dcf46-072b-4d19-aa89-235d80879e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:24.275355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1163/2304] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:24.278295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4556791-3f4a-4d34-8f70-0510b97c1fd1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:24.290877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4556791-3f4a-4d34-8f70-0510b97c1fd1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:24.298247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dc428-ad0c-4588-8918-5f969ac2bf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:24.299567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dc428-ad0c-4588-8918-5f969ac2bf71 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:24.300024 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dc428-ad0c-4588-8918-5f969ac2bf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:24.300437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dc428-ad0c-4588-8918-5f969ac2bf71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:24.301232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dc428-ad0c-4588-8918-5f969ac2bf71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:34:24.301671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dc428-ad0c-4588-8918-5f969ac2bf71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:24.305279 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dc428-ad0c-4588-8918-5f969ac2bf71 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:24.325648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1142/2305] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:34:24.330186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dcf46-072b-4d19-aa89-235d80879e87 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:24.343687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dcf46-072b-4d19-aa89-235d80879e87 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:24.354478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a6b8-e774-4675-9570-fb23b839698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:24.355146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a6b8-e774-4675-9570-fb23b839698b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:24.355428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a6b8-e774-4675-9570-fb23b839698b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:24.356275 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a6b8-e774-4675-9570-fb23b839698b admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:24.356963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a6b8-e774-4675-9570-fb23b839698b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:24.358876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a6b8-e774-4675-9570-fb23b839698b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:24.407867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1164/2306] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:34:24 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:34:24.408034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dc428-ad0c-4588-8918-5f969ac2bf71 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:24.424270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dc428-ad0c-4588-8918-5f969ac2bf71 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:24.483083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8c42c-6094-4fb5-ae2a-2755031beba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:24.483732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8c42c-6094-4fb5-ae2a-2755031beba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:24.484008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8c42c-6094-4fb5-ae2a-2755031beba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:24.484276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8c42c-6094-4fb5-ae2a-2755031beba1 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:24.484906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8c42c-6094-4fb5-ae2a-2755031beba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:24.486879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8c42c-6094-4fb5-ae2a-2755031beba1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:24.511566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1143/2307] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:34:24 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:34:24.515720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a6b8-e774-4675-9570-fb23b839698b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:24.526507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a6b8-e774-4675-9570-fb23b839698b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:24.531382 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a325458-5056-4e51-9618-d81c3fd96851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:24.531981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a325458-5056-4e51-9618-d81c3fd96851 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:24.532255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a325458-5056-4e51-9618-d81c3fd96851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:24.532519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a325458-5056-4e51-9618-d81c3fd96851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:24.533159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a325458-5056-4e51-9618-d81c3fd96851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:24.534763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a325458-5056-4e51-9618-d81c3fd96851 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:24.545609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1165/2308] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:34:24.550015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8c42c-6094-4fb5-ae2a-2755031beba1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:24.560743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8c42c-6094-4fb5-ae2a-2755031beba1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:24.566113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb05483-986f-4a15-8dce-dfb309927315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:24.566832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb05483-986f-4a15-8dce-dfb309927315 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:24.567132 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb05483-986f-4a15-8dce-dfb309927315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:24.567430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb05483-986f-4a15-8dce-dfb309927315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:24.568089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb05483-986f-4a15-8dce-dfb309927315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:24.569701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb05483-986f-4a15-8dce-dfb309927315 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:24.581866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1144/2309] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:24.586115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a325458-5056-4e51-9618-d81c3fd96851 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:24.596475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a325458-5056-4e51-9618-d81c3fd96851 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:24.602506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9232aed-4e39-4b5f-bf30-628df5d6a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:24.603164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232aed-4e39-4b5f-bf30-628df5d6a5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:24.603479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232aed-4e39-4b5f-bf30-628df5d6a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:24.603745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232aed-4e39-4b5f-bf30-628df5d6a5bb admin admin] PATH_INFO: `/v3/projects/5ab96d82908d442d9a5786a8978f01e2/users/39dd2725c47749c3924f9750554e7237/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:24.621059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232aed-4e39-4b5f-bf30-628df5d6a5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab96d82908d442d9a5786a8978f01e2, user_id=39dd2725c47749c3924f9750554e7237, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:24.624007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232aed-4e39-4b5f-bf30-628df5d6a5bb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:24.639084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1166/2310] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:24 2022] PUT /identity/v3/projects/5ab96d82908d442d9a5786a8978f01e2/users/39dd2725c47749c3924f9750554e7237/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:34:24.650401 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36726b-5c2a-4ca9-a0ce-d0baa66c7f4f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:24.650729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36726b-5c2a-4ca9-a0ce-d0baa66c7f4f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:24.651026 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36726b-5c2a-4ca9-a0ce-d0baa66c7f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:24.682859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ab36726b-5c2a-4ca9-a0ce-d0baa66c7f4f None None] MFA Rules not processed for user `39dd2725c47749c3924f9750554e7237`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:24.684214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ab36726b-5c2a-4ca9-a0ce-d0baa66c7f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:24.752579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1145/2311] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:34:24.764161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9232aed-4e39-4b5f-bf30-628df5d6a5bb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:24.765851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f9232aed-4e39-4b5f-bf30-628df5d6a5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:24.788534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:24.825633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9232aed-4e39-4b5f-bf30-628df5d6a5bb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:24.829469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fd3d7-f577-431e-9168-54f491a02947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:24.830076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd3d7-f577-431e-9168-54f491a02947 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:24.830351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd3d7-f577-431e-9168-54f491a02947 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:24.830619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd3d7-f577-431e-9168-54f491a02947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:24.840100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fd3d7-f577-431e-9168-54f491a02947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:24.841518 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fd3d7-f577-431e-9168-54f491a02947 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:24.850617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1167/2312] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:27.475817 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36726b-5c2a-4ca9-a0ce-d0baa66c7f4f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:27.496933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:27.544892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36726b-5c2a-4ca9-a0ce-d0baa66c7f4f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:27.549472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:27.550134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:27.550408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:27.550677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] PATH_INFO: `/v3/users/39dd2725c47749c3924f9750554e7237` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:27.551890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=39dd2725c47749c3924f9750554e7237)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:27.553912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:27.618954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39dd2725c47749c3924f9750554e7237'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:27.619818 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39dd2725c47749c3924f9750554e7237'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:27.630779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39dd2725c47749c3924f9750554e7237'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:27.655151 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39dd2725c47749c3924f9750554e7237'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:27.662516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39dd2725c47749c3924f9750554e7237'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:27.668962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1146/2313] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:34:27 2022] DELETE /identity/v3/users/39dd2725c47749c3924f9750554e7237 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:27.674536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ea5b0-f7db-4c15-9223-9069f0f186dd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:27.675129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ea5b0-f7db-4c15-9223-9069f0f186dd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:27.675366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ea5b0-f7db-4c15-9223-9069f0f186dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:27.695812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-246ea5b0-f7db-4c15-9223-9069f0f186dd None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:27.696429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-246ea5b0-f7db-4c15-9223-9069f0f186dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:27.763762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1168/2314] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:27.773656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:27.775070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:27.845393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ccbc5-c48c-4d8f-92c4-11df60b2a9ea admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:27.849548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbcc0c-1e49-4490-bacc-aac8dd46dfd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:27.850288 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbcc0c-1e49-4490-bacc-aac8dd46dfd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:27.850651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbcc0c-1e49-4490-bacc-aac8dd46dfd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:27.851021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbcc0c-1e49-4490-bacc-aac8dd46dfd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:27.861178 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbcc0c-1e49-4490-bacc-aac8dd46dfd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:27.862625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbcc0c-1e49-4490-bacc-aac8dd46dfd6 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:27.873926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1147/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:34:28.219048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ea5b0-f7db-4c15-9223-9069f0f186dd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:28.220829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-246ea5b0-f7db-4c15-9223-9069f0f186dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:28.233435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ea5b0-f7db-4c15-9223-9069f0f186dd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:28.240317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:28.240972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:28.241247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:28.241501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] PATH_INFO: `/v3/projects/5ab96d82908d442d9a5786a8978f01e2` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:28.242764 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab96d82908d442d9a5786a8978f01e2)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:28.244710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:28.320192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab96d82908d442d9a5786a8978f01e2', 'request_id': 'req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:28.329685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab96d82908d442d9a5786a8978f01e2', 'request_id': 'req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:28.337500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab96d82908d442d9a5786a8978f01e2', 'request_id': 'req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:28.349671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] The token cache is being invalidate because project 5ab96d82908d442d9a5786a8978f01e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:34:28.350236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:28.350940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6be6a5ff-7a85-4517-97e3-5b7ab396cc16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:34:28.352515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1169/2316] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:34:28 2022] DELETE /identity/v3/projects/5ab96d82908d442d9a5786a8978f01e2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:28.358007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e25c-da17-4e40-b505-9f5c338b2eb0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:28.358283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e25c-da17-4e40-b505-9f5c338b2eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:28.358549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e25c-da17-4e40-b505-9f5c338b2eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:28.380789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5fc5e25c-da17-4e40-b505-9f5c338b2eb0 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:28.381952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5fc5e25c-da17-4e40-b505-9f5c338b2eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:28.421040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:28.451815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1148/2317] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:28.460114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13266ea4-cdf2-4d28-97a0-e3493d64c150 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:28.460401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13266ea4-cdf2-4d28-97a0-e3493d64c150 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:28.460673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13266ea4-cdf2-4d28-97a0-e3493d64c150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:28.482798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-13266ea4-cdf2-4d28-97a0-e3493d64c150 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:28.484077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-13266ea4-cdf2-4d28-97a0-e3493d64c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:28.493844 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1170/2318] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:28.498537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e25c-da17-4e40-b505-9f5c338b2eb0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:28.509335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e25c-da17-4e40-b505-9f5c338b2eb0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:28.514909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc9d5a-9637-4d07-b5eb-7ddfe4cc8116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:28.515866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9d5a-9637-4d07-b5eb-7ddfe4cc8116 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:28.516323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9d5a-9637-4d07-b5eb-7ddfe4cc8116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:28.516750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9d5a-9637-4d07-b5eb-7ddfe4cc8116 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:28.517575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc9d5a-9637-4d07-b5eb-7ddfe4cc8116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:34:28.518032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc9d5a-9637-4d07-b5eb-7ddfe4cc8116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:28.519857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc9d5a-9637-4d07-b5eb-7ddfe4cc8116 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:28.536212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1149/2319] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:34:28.537422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13266ea4-cdf2-4d28-97a0-e3493d64c150 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:28.552826 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13266ea4-cdf2-4d28-97a0-e3493d64c150 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:28.557727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f18e6d-0fd1-4f6f-9271-a178067d54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:28.558353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f18e6d-0fd1-4f6f-9271-a178067d54bf admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:28.558628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f18e6d-0fd1-4f6f-9271-a178067d54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:28.558895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f18e6d-0fd1-4f6f-9271-a178067d54bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:28.559576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f18e6d-0fd1-4f6f-9271-a178067d54bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:28.561527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f18e6d-0fd1-4f6f-9271-a178067d54bf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:28.590801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1171/2320] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:34:28 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:34:28.595239 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc9d5a-9637-4d07-b5eb-7ddfe4cc8116 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:28.606567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc9d5a-9637-4d07-b5eb-7ddfe4cc8116 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:28.684862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607dfa0-9fa3-46cb-b189-bac7f73c1a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:28.685484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607dfa0-9fa3-46cb-b189-bac7f73c1a41 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:28.685750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607dfa0-9fa3-46cb-b189-bac7f73c1a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:28.686011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607dfa0-9fa3-46cb-b189-bac7f73c1a41 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:28.686636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607dfa0-9fa3-46cb-b189-bac7f73c1a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:28.688634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607dfa0-9fa3-46cb-b189-bac7f73c1a41 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:28.725890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1150/2321] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:34:28 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:34:28.729993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f18e6d-0fd1-4f6f-9271-a178067d54bf admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:28.741406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f18e6d-0fd1-4f6f-9271-a178067d54bf admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:28.746299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa6d79-d552-4023-8a7c-e1c28c7f11d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:28.746848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6d79-d552-4023-8a7c-e1c28c7f11d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:28.747146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6d79-d552-4023-8a7c-e1c28c7f11d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:28.747445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6d79-d552-4023-8a7c-e1c28c7f11d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:28.748097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa6d79-d552-4023-8a7c-e1c28c7f11d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:28.749701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa6d79-d552-4023-8a7c-e1c28c7f11d5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:28.760231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1172/2322] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:28.764358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607dfa0-9fa3-46cb-b189-bac7f73c1a41 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:28.774936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607dfa0-9fa3-46cb-b189-bac7f73c1a41 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:28.779904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3f5a0-6b63-4299-a4b4-e3d1aed069b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:28.780496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3f5a0-6b63-4299-a4b4-e3d1aed069b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:28.780771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3f5a0-6b63-4299-a4b4-e3d1aed069b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:28.781038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3f5a0-6b63-4299-a4b4-e3d1aed069b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:28.781715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3f5a0-6b63-4299-a4b4-e3d1aed069b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:28.783349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3f5a0-6b63-4299-a4b4-e3d1aed069b9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:28.795335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1151/2323] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:28.803835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa6d79-d552-4023-8a7c-e1c28c7f11d5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:28.814157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa6d79-d552-4023-8a7c-e1c28c7f11d5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:28.820656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d2953-300c-498c-bced-5d77d2102900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:28.821341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d2953-300c-498c-bced-5d77d2102900 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:28.821616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d2953-300c-498c-bced-5d77d2102900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:28.821888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d2953-300c-498c-bced-5d77d2102900 admin admin] PATH_INFO: `/v3/projects/a3773bfb98954a4dabb5eeb46e2738b1/users/cedf7db74e0d4ca181b41a3f3ba6e7ab/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:28.824330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:28.839975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d2953-300c-498c-bced-5d77d2102900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3773bfb98954a4dabb5eeb46e2738b1, user_id=cedf7db74e0d4ca181b41a3f3ba6e7ab, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:28.842766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d2953-300c-498c-bced-5d77d2102900 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:28.856472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1173/2324] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:28 2022] PUT /identity/v3/projects/a3773bfb98954a4dabb5eeb46e2738b1/users/cedf7db74e0d4ca181b41a3f3ba6e7ab/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:28.861691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b566-990e-47ad-b275-fa2f66bc6b4c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:28.862078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b566-990e-47ad-b275-fa2f66bc6b4c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:28.862404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b566-990e-47ad-b275-fa2f66bc6b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:28.882852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c4a6b566-990e-47ad-b275-fa2f66bc6b4c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:28.884135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c4a6b566-990e-47ad-b275-fa2f66bc6b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:28.944019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1152/2325] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:28.954135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d2953-300c-498c-bced-5d77d2102900 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:28.958082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ee9d2953-300c-498c-bced-5d77d2102900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:29.043547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d2953-300c-498c-bced-5d77d2102900 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:29.048083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a8197-d93c-4180-acc8-b901e33c595f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:29.048730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a8197-d93c-4180-acc8-b901e33c595f service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:29.049038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a8197-d93c-4180-acc8-b901e33c595f service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:29.049367 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a8197-d93c-4180-acc8-b901e33c595f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:29.060406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a8197-d93c-4180-acc8-b901e33c595f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:29.061870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a8197-d93c-4180-acc8-b901e33c595f service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:29.077022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1174/2326] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:33.233643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a90fa5-fc6d-41ce-8ebc-2017e28b7d83 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:33.234176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a90fa5-fc6d-41ce-8ebc-2017e28b7d83 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:33.234516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a90fa5-fc6d-41ce-8ebc-2017e28b7d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:33.273811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-08a90fa5-fc6d-41ce-8ebc-2017e28b7d83 None None] MFA Rules not processed for user `cedf7db74e0d4ca181b41a3f3ba6e7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:33.275325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-08a90fa5-fc6d-41ce-8ebc-2017e28b7d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:33.339674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:33.381118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1153/2327] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:33.386872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a8197-d93c-4180-acc8-b901e33c595f service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:33.401265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a8197-d93c-4180-acc8-b901e33c595f service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:33.422858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e26c-f7c1-4bb9-9057-af228d5815ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:33.422858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e26c-f7c1-4bb9-9057-af228d5815ad admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:33.422858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e26c-f7c1-4bb9-9057-af228d5815ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:33.422858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e26c-f7c1-4bb9-9057-af228d5815ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:33.429017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e26c-f7c1-4bb9-9057-af228d5815ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:33.431049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e26c-f7c1-4bb9-9057-af228d5815ad admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:33.479420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1175/2328] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:34:33 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:34:33.483752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a90fa5-fc6d-41ce-8ebc-2017e28b7d83 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:33.496769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a90fa5-fc6d-41ce-8ebc-2017e28b7d83 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:33.566692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d40e5-c263-4d01-a841-ccc241a77769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:33.567473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d40e5-c263-4d01-a841-ccc241a77769 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:33.567909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d40e5-c263-4d01-a841-ccc241a77769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:33.568286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d40e5-c263-4d01-a841-ccc241a77769 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:33.569009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d40e5-c263-4d01-a841-ccc241a77769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:33.571020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d40e5-c263-4d01-a841-ccc241a77769 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:33.596225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1154/2329] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:34:33 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:34:33.600211 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e26c-f7c1-4bb9-9057-af228d5815ad admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:33.615734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e26c-f7c1-4bb9-9057-af228d5815ad admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:33.625529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331d92-d166-4fd0-afce-c2d4f8c703ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:33.626158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331d92-d166-4fd0-afce-c2d4f8c703ec admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:33.626430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331d92-d166-4fd0-afce-c2d4f8c703ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:33.626695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331d92-d166-4fd0-afce-c2d4f8c703ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:33.627380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85331d92-d166-4fd0-afce-c2d4f8c703ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:33.628981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85331d92-d166-4fd0-afce-c2d4f8c703ec admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:33.640691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1176/2330] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:33.644734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d40e5-c263-4d01-a841-ccc241a77769 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:33.655684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d40e5-c263-4d01-a841-ccc241a77769 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:33.660707 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d419264-f43c-49b0-91a9-8ec89065a878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:33.661670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d419264-f43c-49b0-91a9-8ec89065a878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:33.661953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d419264-f43c-49b0-91a9-8ec89065a878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:33.662226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d419264-f43c-49b0-91a9-8ec89065a878 admin admin] PATH_INFO: `/v3/projects/a001c37333734d469eba3e9ee374cebb/users/f8f277a284cf4ed090d2e2a8999a668c/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:33.678868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d419264-f43c-49b0-91a9-8ec89065a878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a001c37333734d469eba3e9ee374cebb, user_id=f8f277a284cf4ed090d2e2a8999a668c, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:33.681586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d419264-f43c-49b0-91a9-8ec89065a878 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:33.696716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1155/2331] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:33 2022] PUT /identity/v3/projects/a001c37333734d469eba3e9ee374cebb/users/f8f277a284cf4ed090d2e2a8999a668c/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:34:33.700790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331d92-d166-4fd0-afce-c2d4f8c703ec admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:33.711263 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331d92-d166-4fd0-afce-c2d4f8c703ec admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:33.775188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc1390-54a0-4e76-b99c-d4ffcc12f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:33.775907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc1390-54a0-4e76-b99c-d4ffcc12f7cf admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:33.776377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc1390-54a0-4e76-b99c-d4ffcc12f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:33.776727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc1390-54a0-4e76-b99c-d4ffcc12f7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:33.777510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc1390-54a0-4e76-b99c-d4ffcc12f7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:33.779184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc1390-54a0-4e76-b99c-d4ffcc12f7cf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:33.793739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1177/2332] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:34:33.795267 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d419264-f43c-49b0-91a9-8ec89065a878 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:33.806648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d419264-f43c-49b0-91a9-8ec89065a878 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:33.811699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6a769-62aa-45f9-8052-5c89d1593c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:33.812368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6a769-62aa-45f9-8052-5c89d1593c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:33.812638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6a769-62aa-45f9-8052-5c89d1593c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:33.812902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6a769-62aa-45f9-8052-5c89d1593c7d admin admin] PATH_INFO: `/v3/projects/a001c37333734d469eba3e9ee374cebb/users/f8f277a284cf4ed090d2e2a8999a668c/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:33.815541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6a769-62aa-45f9-8052-5c89d1593c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a001c37333734d469eba3e9ee374cebb, user_id=f8f277a284cf4ed090d2e2a8999a668c, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:33.818614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6a769-62aa-45f9-8052-5c89d1593c7d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:33.832240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1156/2333] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:34:33 2022] PUT /identity/v3/projects/a001c37333734d469eba3e9ee374cebb/users/f8f277a284cf4ed090d2e2a8999a668c/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:34:38.738422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7848559-bed0-40ab-aa96-0a7205978a0c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:38.739274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7848559-bed0-40ab-aa96-0a7205978a0c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:38.739274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7848559-bed0-40ab-aa96-0a7205978a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:38.773845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f7848559-bed0-40ab-aa96-0a7205978a0c None None] MFA Rules not processed for user `f8f277a284cf4ed090d2e2a8999a668c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:38.774072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f7848559-bed0-40ab-aa96-0a7205978a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:38.826997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:38.863342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1178/2334] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:34:38.877183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6a769-62aa-45f9-8052-5c89d1593c7d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:38.883489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-aac6a769-62aa-45f9-8052-5c89d1593c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:38.983686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6a769-62aa-45f9-8052-5c89d1593c7d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:38.989719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad9803-4349-4a3e-86a2-5abb0e69ac83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:38.990334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9803-4349-4a3e-86a2-5abb0e69ac83 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:38.990608 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9803-4349-4a3e-86a2-5abb0e69ac83 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:38.990876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9803-4349-4a3e-86a2-5abb0e69ac83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:39.024021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:39.058218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad9803-4349-4a3e-86a2-5abb0e69ac83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:39.060002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad9803-4349-4a3e-86a2-5abb0e69ac83 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:39.069228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1157/2335] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:34:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:34:40.073355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77c2ec-595c-4067-a24f-156c361b6fa3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:40.075525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77c2ec-595c-4067-a24f-156c361b6fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:40.076030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77c2ec-595c-4067-a24f-156c361b6fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:40.098386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ec77c2ec-595c-4067-a24f-156c361b6fa3 None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:40.100204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ec77c2ec-595c-4067-a24f-156c361b6fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:40.174027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1179/2336] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:34:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:40.222815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad9803-4349-4a3e-86a2-5abb0e69ac83 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:34:40.224548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-33ad9803-4349-4a3e-86a2-5abb0e69ac83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:40.304513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72add8-100f-4d7d-906e-815429a22a79 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:40.305121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72add8-100f-4d7d-906e-815429a22a79 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:40.305617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72add8-100f-4d7d-906e-815429a22a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:40.320595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad9803-4349-4a3e-86a2-5abb0e69ac83 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:34:40.326204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154a94b-f362-44a7-a083-e7cd983eed2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:34:40.326976 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154a94b-f362-44a7-a083-e7cd983eed2f service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:40.327486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154a94b-f362-44a7-a083-e7cd983eed2f service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:40.327741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154a94b-f362-44a7-a083-e7cd983eed2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:40.332469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2c72add8-100f-4d7d-906e-815429a22a79 None None] MFA Rules not processed for user `cedf7db74e0d4ca181b41a3f3ba6e7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:40.333994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2c72add8-100f-4d7d-906e-815429a22a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:40.336943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154a94b-f362-44a7-a083-e7cd983eed2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:34:40.338599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154a94b-f362-44a7-a083-e7cd983eed2f service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:34:40.342615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1180/2337] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:34:40.349854 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1158/2338] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:34:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:34:50.322333 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=40 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:50.345683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=48 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:53.710078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0a697-8b57-4740-a93c-e6c97f8c36b8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:34:53.710686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0a697-8b57-4740-a93c-e6c97f8c36b8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:34:53.710871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0a697-8b57-4740-a93c-e6c97f8c36b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:34:53.733646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8bc0a697-8b57-4740-a93c-e6c97f8c36b8 None None] MFA Rules not processed for user `3b8b820bb8ad4599837afad008daf413`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:34:53.734954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8bc0a697-8b57-4740-a93c-e6c97f8c36b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:34:53.799829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1181/2339] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:34:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:03.792562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=25 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:09.923186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6610b-6a05-4c96-8c7d-4382acbe7dfd None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:09.923719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6610b-6a05-4c96-8c7d-4382acbe7dfd None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:09.923809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6610b-6a05-4c96-8c7d-4382acbe7dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:09.943373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ddd6610b-6a05-4c96-8c7d-4382acbe7dfd None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:09.944612 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ddd6610b-6a05-4c96-8c7d-4382acbe7dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:09.952445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1159/2340] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 6 04:35:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:09.965835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0a697-8b57-4740-a93c-e6c97f8c36b8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:09.978031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0a697-8b57-4740-a93c-e6c97f8c36b8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:09.983162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77f5f2-0bcf-4c22-983f-3de01ea295de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:09.983865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77f5f2-0bcf-4c22-983f-3de01ea295de service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:09.984147 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77f5f2-0bcf-4c22-983f-3de01ea295de service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:09.984419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77f5f2-0bcf-4c22-983f-3de01ea295de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:09.993374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77f5f2-0bcf-4c22-983f-3de01ea295de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:09.994978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77f5f2-0bcf-4c22-983f-3de01ea295de service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:10.004304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1182/2341] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:35:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:35:11.968810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed4a78-2dfe-4ecc-b811-29fb375f9ba7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:11.970525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed4a78-2dfe-4ecc-b811-29fb375f9ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:11.970911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed4a78-2dfe-4ecc-b811-29fb375f9ba7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:11.972633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1160/2342] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:35:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:35:11.981529 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c567d3d-ca44-4693-af10-bf1f6892e324 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:11.982016 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c567d3d-ca44-4693-af10-bf1f6892e324 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:11.982110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c567d3d-ca44-4693-af10-bf1f6892e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:12.016701 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7c567d3d-ca44-4693-af10-bf1f6892e324 None None] MFA Rules not processed for user `ff4e48fdc18e424fa2cf80fd5da332b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:12.017930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7c567d3d-ca44-4693-af10-bf1f6892e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:12.048728 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed4a78-2dfe-4ecc-b811-29fb375f9ba7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:12.051222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-baed4a78-2dfe-4ecc-b811-29fb375f9ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:12.095911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1183/2343] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:12.106784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c567d3d-ca44-4693-af10-bf1f6892e324 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:12.108232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7c567d3d-ca44-4693-af10-bf1f6892e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:12.121339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c567d3d-ca44-4693-af10-bf1f6892e324 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:12.121960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed4a78-2dfe-4ecc-b811-29fb375f9ba7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:12.126505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9ba51-48b9-449a-b129-32ac67e4c23d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:12.126666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:12.127227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9ba51-48b9-449a-b129-32ac67e4c23d service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:12.127393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:12.127565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:12.127674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9ba51-48b9-449a-b129-32ac67e4c23d service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:12.127811 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] PATH_INFO: `/v3/users/38ad994421e24faa85d84691b53a6b5c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:12.127905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9ba51-48b9-449a-b129-32ac67e4c23d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:12.128962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ad994421e24faa85d84691b53a6b5c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:12.130880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:12.136655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9ba51-48b9-449a-b129-32ac67e4c23d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:12.138284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9ba51-48b9-449a-b129-32ac67e4c23d service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:12.149617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1184/2344] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:35:12.179804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ad994421e24faa85d84691b53a6b5c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:12.180393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ad994421e24faa85d84691b53a6b5c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:12.192244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ad994421e24faa85d84691b53a6b5c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:12.204616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ad994421e24faa85d84691b53a6b5c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:12.211697 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8b352fc3-9d41-42a5-963c-99172719d9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ad994421e24faa85d84691b53a6b5c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:12.218055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1161/2345] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:35:12 2022] DELETE /identity/v3/users/38ad994421e24faa85d84691b53a6b5c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:35:12.646850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9ba51-48b9-449a-b129-32ac67e4c23d service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:12.658231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9ba51-48b9-449a-b129-32ac67e4c23d service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:12.717718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:12.718375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:12.718649 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:12.719019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] PATH_INFO: `/v3/projects/c952f6e7ace24e15a0d1db8bbbd95044` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:12.720388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c952f6e7ace24e15a0d1db8bbbd95044)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:12.722287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:12.774889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c952f6e7ace24e15a0d1db8bbbd95044', 'request_id': 'req-0f0b139b-6058-4734-96df-c1e84d630b35'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:12.782706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c952f6e7ace24e15a0d1db8bbbd95044', 'request_id': 'req-0f0b139b-6058-4734-96df-c1e84d630b35'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:12.788396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c952f6e7ace24e15a0d1db8bbbd95044', 'request_id': 'req-0f0b139b-6058-4734-96df-c1e84d630b35'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:12.796585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:12.801411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] The token cache is being invalidate because project c952f6e7ace24e15a0d1db8bbbd95044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:35:12.801888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:12.802936 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0f0b139b-6058-4734-96df-c1e84d630b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:12.804706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1185/2346] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:35:12 2022] DELETE /identity/v3/projects/c952f6e7ace24e15a0d1db8bbbd95044 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:35:12.816215 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f38c6-0577-402d-90aa-312df47b9f26 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:12.817122 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f38c6-0577-402d-90aa-312df47b9f26 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:12.817122 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f38c6-0577-402d-90aa-312df47b9f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:12.840374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b18f38c6-0577-402d-90aa-312df47b9f26 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:12.841589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b18f38c6-0577-402d-90aa-312df47b9f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:12.904269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1162/2347] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:12.913860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58315e-053a-4d7d-9973-a410e828ff3f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:12.914232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58315e-053a-4d7d-9973-a410e828ff3f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:12.914590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58315e-053a-4d7d-9973-a410e828ff3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:12.939071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-de58315e-053a-4d7d-9973-a410e828ff3f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:12.940342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-de58315e-053a-4d7d-9973-a410e828ff3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:12.949716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1186/2348] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:12.954782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f38c6-0577-402d-90aa-312df47b9f26 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:12.964855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f38c6-0577-402d-90aa-312df47b9f26 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:12.970091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668de8ce-c8df-4a20-a421-8ced9c1d8391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:12.970711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de8ce-c8df-4a20-a421-8ced9c1d8391 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:12.970948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de8ce-c8df-4a20-a421-8ced9c1d8391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:12.971218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de8ce-c8df-4a20-a421-8ced9c1d8391 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:12.971866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668de8ce-c8df-4a20-a421-8ced9c1d8391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:35:12.972179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668de8ce-c8df-4a20-a421-8ced9c1d8391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:12.973794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668de8ce-c8df-4a20-a421-8ced9c1d8391 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:12.985787 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:12.989953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1163/2349] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:35:12.993929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58315e-053a-4d7d-9973-a410e828ff3f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:13.003651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58315e-053a-4d7d-9973-a410e828ff3f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:13.008662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de745d4d-dd5c-4f61-9bae-60b30f30ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:13.009328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de745d4d-dd5c-4f61-9bae-60b30f30ea83 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:13.009599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de745d4d-dd5c-4f61-9bae-60b30f30ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:13.009853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de745d4d-dd5c-4f61-9bae-60b30f30ea83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:13.010492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de745d4d-dd5c-4f61-9bae-60b30f30ea83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:13.012441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de745d4d-dd5c-4f61-9bae-60b30f30ea83 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:13.042094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1187/2350] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:35:12 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:35:13.046739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668de8ce-c8df-4a20-a421-8ced9c1d8391 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:13.058679 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668de8ce-c8df-4a20-a421-8ced9c1d8391 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:13.116489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9497d2-8744-4e0c-9a53-0c4bb884d9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:13.117107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9497d2-8744-4e0c-9a53-0c4bb884d9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:13.117388 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9497d2-8744-4e0c-9a53-0c4bb884d9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:13.117661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9497d2-8744-4e0c-9a53-0c4bb884d9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:13.118300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9497d2-8744-4e0c-9a53-0c4bb884d9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:13.120299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9497d2-8744-4e0c-9a53-0c4bb884d9b4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:13.143992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1164/2351] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:35:13 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:35:13.148146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de745d4d-dd5c-4f61-9bae-60b30f30ea83 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:13.159029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de745d4d-dd5c-4f61-9bae-60b30f30ea83 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:13.163790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63495fbf-830f-4af4-882c-b1e7f529216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:13.164402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63495fbf-830f-4af4-882c-b1e7f529216e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:13.164687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63495fbf-830f-4af4-882c-b1e7f529216e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:13.164947 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63495fbf-830f-4af4-882c-b1e7f529216e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:13.165591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63495fbf-830f-4af4-882c-b1e7f529216e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:13.167234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63495fbf-830f-4af4-882c-b1e7f529216e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:13.177549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1188/2352] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:35:13.181589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9497d2-8744-4e0c-9a53-0c4bb884d9b4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:13.192222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9497d2-8744-4e0c-9a53-0c4bb884d9b4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:13.198180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cda7ab-f4c2-42df-9341-b113543fcbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:13.199021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cda7ab-f4c2-42df-9341-b113543fcbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:13.199342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cda7ab-f4c2-42df-9341-b113543fcbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:13.199802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cda7ab-f4c2-42df-9341-b113543fcbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:13.200419 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cda7ab-f4c2-42df-9341-b113543fcbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:13.202255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cda7ab-f4c2-42df-9341-b113543fcbd7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:13.213705 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1165/2353] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:35:13.218024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63495fbf-830f-4af4-882c-b1e7f529216e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:13.229165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63495fbf-830f-4af4-882c-b1e7f529216e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:13.234334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ef7f5-e399-4aa8-b55b-0b43ce62d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:13.234980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef7f5-e399-4aa8-b55b-0b43ce62d570 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:13.235269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef7f5-e399-4aa8-b55b-0b43ce62d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:13.235580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef7f5-e399-4aa8-b55b-0b43ce62d570 admin admin] PATH_INFO: `/v3/projects/b641727c1a654ca98aee37ccae8939c4/users/ff726176d46741e4aeba3fc6675627f3/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:13.251213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ef7f5-e399-4aa8-b55b-0b43ce62d570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b641727c1a654ca98aee37ccae8939c4, user_id=ff726176d46741e4aeba3fc6675627f3, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:13.253813 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ef7f5-e399-4aa8-b55b-0b43ce62d570 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:13.269736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1189/2354] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:35:13 2022] PUT /identity/v3/projects/b641727c1a654ca98aee37ccae8939c4/users/ff726176d46741e4aeba3fc6675627f3/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:35:13.284073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9949-42ca-4cff-a5d5-61b052ea396b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:13.284351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9949-42ca-4cff-a5d5-61b052ea396b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:13.284615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9949-42ca-4cff-a5d5-61b052ea396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:13.312839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7a4b9949-42ca-4cff-a5d5-61b052ea396b None None] MFA Rules not processed for user `ff726176d46741e4aeba3fc6675627f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:13.314040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7a4b9949-42ca-4cff-a5d5-61b052ea396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:13.382201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1166/2355] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:35:13.394205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ef7f5-e399-4aa8-b55b-0b43ce62d570 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:13.396086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-565ef7f5-e399-4aa8-b55b-0b43ce62d570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:13.454610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ef7f5-e399-4aa8-b55b-0b43ce62d570 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:13.458552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6acfa8-e691-45c2-a2e4-843ddcb7a1bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:13.459171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6acfa8-e691-45c2-a2e4-843ddcb7a1bf service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:13.459489 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6acfa8-e691-45c2-a2e4-843ddcb7a1bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:13.459759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6acfa8-e691-45c2-a2e4-843ddcb7a1bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:13.468853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6acfa8-e691-45c2-a2e4-843ddcb7a1bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:13.470303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6acfa8-e691-45c2-a2e4-843ddcb7a1bf service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:13.479695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1190/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:35:13.506637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b9949-42ca-4cff-a5d5-61b052ea396b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:13.576573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b9949-42ca-4cff-a5d5-61b052ea396b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:13.583675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:13.584651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:13.585006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:13.585345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] PATH_INFO: `/v3/users/ff726176d46741e4aeba3fc6675627f3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:13.586763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff726176d46741e4aeba3fc6675627f3)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:13.588940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:13.605263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:13.644780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff726176d46741e4aeba3fc6675627f3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:13.645434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff726176d46741e4aeba3fc6675627f3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:13.654192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff726176d46741e4aeba3fc6675627f3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:13.672476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff726176d46741e4aeba3fc6675627f3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:13.679708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff726176d46741e4aeba3fc6675627f3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:13.686478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1167/2357] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:35:13 2022] DELETE /identity/v3/users/ff726176d46741e4aeba3fc6675627f3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:35:13.691244 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce5e76-60d9-4fb8-a2e2-74ae077aaa2a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:13.691550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce5e76-60d9-4fb8-a2e2-74ae077aaa2a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:13.691816 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce5e76-60d9-4fb8-a2e2-74ae077aaa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:13.712434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0dce5e76-60d9-4fb8-a2e2-74ae077aaa2a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:13.713639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0dce5e76-60d9-4fb8-a2e2-74ae077aaa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:13.774479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1191/2358] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:13.784121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:13.785579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:13.844018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b12a33-9ccb-41b4-b46d-3fac9c1a73c1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:13.848154 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc02cdf-067b-43ec-84b7-2791d7e769ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:13.848756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc02cdf-067b-43ec-84b7-2791d7e769ab service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:13.849021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc02cdf-067b-43ec-84b7-2791d7e769ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:13.849282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc02cdf-067b-43ec-84b7-2791d7e769ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:13.858548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc02cdf-067b-43ec-84b7-2791d7e769ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:13.860172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc02cdf-067b-43ec-84b7-2791d7e769ab service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:13.870075 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1168/2359] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:35:14.147098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce5e76-60d9-4fb8-a2e2-74ae077aaa2a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:14.148582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0dce5e76-60d9-4fb8-a2e2-74ae077aaa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:14.167431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce5e76-60d9-4fb8-a2e2-74ae077aaa2a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:14.172851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:14.173623 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.173769 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.174049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] PATH_INFO: `/v3/projects/b641727c1a654ca98aee37ccae8939c4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.175213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b641727c1a654ca98aee37ccae8939c4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:14.177224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:14.219294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:14.231847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b641727c1a654ca98aee37ccae8939c4', 'request_id': 'req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:14.241624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b641727c1a654ca98aee37ccae8939c4', 'request_id': 'req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:14.247598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b641727c1a654ca98aee37ccae8939c4', 'request_id': 'req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:14.258951 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] The token cache is being invalidate because project b641727c1a654ca98aee37ccae8939c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:35:14.259242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:14.259887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6fb487f5-91c9-4738-bba3-4cfb7a20ed0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:14.261375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1192/2360] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:35:14 2022] DELETE /identity/v3/projects/b641727c1a654ca98aee37ccae8939c4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:35:14.266558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0ed8c-9ed0-4974-ba08-d9be57929b30 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.267104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0ed8c-9ed0-4974-ba08-d9be57929b30 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.267104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0ed8c-9ed0-4974-ba08-d9be57929b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.287233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b9f0ed8c-9ed0-4974-ba08-d9be57929b30 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:14.288382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b9f0ed8c-9ed0-4974-ba08-d9be57929b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:14.360486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1169/2361] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:14.368993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f7ebb-9f11-4ab1-a170-d3e743ce4e58 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.369281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f7ebb-9f11-4ab1-a170-d3e743ce4e58 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.369559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f7ebb-9f11-4ab1-a170-d3e743ce4e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.392571 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-273f7ebb-9f11-4ab1-a170-d3e743ce4e58 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:14.393835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-273f7ebb-9f11-4ab1-a170-d3e743ce4e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:14.402662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1193/2362] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:14.407134 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0ed8c-9ed0-4974-ba08-d9be57929b30 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:14.417280 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0ed8c-9ed0-4974-ba08-d9be57929b30 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:14.422931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e3e25-62b0-40a6-b478-5a56bb63f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:14.423599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e3e25-62b0-40a6-b478-5a56bb63f141 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.423866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e3e25-62b0-40a6-b478-5a56bb63f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.424125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e3e25-62b0-40a6-b478-5a56bb63f141 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.424748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e3e25-62b0-40a6-b478-5a56bb63f141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:35:14.425048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e3e25-62b0-40a6-b478-5a56bb63f141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:14.426656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e3e25-62b0-40a6-b478-5a56bb63f141 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:14.438747 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1170/2363] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:35:14.443168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f7ebb-9f11-4ab1-a170-d3e743ce4e58 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:14.453163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f7ebb-9f11-4ab1-a170-d3e743ce4e58 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:14.458794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925a3a-7a50-49e3-b21e-b3b3626fcced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:14.459421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925a3a-7a50-49e3-b21e-b3b3626fcced admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.459695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925a3a-7a50-49e3-b21e-b3b3626fcced admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.460006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925a3a-7a50-49e3-b21e-b3b3626fcced admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.460632 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32925a3a-7a50-49e3-b21e-b3b3626fcced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:14.462509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32925a3a-7a50-49e3-b21e-b3b3626fcced admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:14.494466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1194/2364] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:35:14 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:35:14.498660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e3e25-62b0-40a6-b478-5a56bb63f141 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:14.509315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e3e25-62b0-40a6-b478-5a56bb63f141 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:14.524037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:14.575586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a41e5c-2dec-4345-a6c6-db9156fccbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:14.576197 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a41e5c-2dec-4345-a6c6-db9156fccbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.576468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a41e5c-2dec-4345-a6c6-db9156fccbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.576729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a41e5c-2dec-4345-a6c6-db9156fccbc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.577377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a41e5c-2dec-4345-a6c6-db9156fccbc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:14.579397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a41e5c-2dec-4345-a6c6-db9156fccbc0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:14.606933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1171/2365] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:35:14 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:35:14.611436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925a3a-7a50-49e3-b21e-b3b3626fcced admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:14.627427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925a3a-7a50-49e3-b21e-b3b3626fcced admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:14.631748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb19d7b-4b42-4f3f-892f-1cbeebbc683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:14.632472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb19d7b-4b42-4f3f-892f-1cbeebbc683e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.632813 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb19d7b-4b42-4f3f-892f-1cbeebbc683e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.633173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb19d7b-4b42-4f3f-892f-1cbeebbc683e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.633890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb19d7b-4b42-4f3f-892f-1cbeebbc683e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:14.635608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb19d7b-4b42-4f3f-892f-1cbeebbc683e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:14.646533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1195/2366] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:35:14.650791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a41e5c-2dec-4345-a6c6-db9156fccbc0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:14.661360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a41e5c-2dec-4345-a6c6-db9156fccbc0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:14.666709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f92b28-5602-45a5-8ef5-ee0f5c334c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:14.667464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92b28-5602-45a5-8ef5-ee0f5c334c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.667795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92b28-5602-45a5-8ef5-ee0f5c334c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.668138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92b28-5602-45a5-8ef5-ee0f5c334c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.668891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f92b28-5602-45a5-8ef5-ee0f5c334c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:14.670544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f92b28-5602-45a5-8ef5-ee0f5c334c5c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:14.682142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1172/2367] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:35:14.686657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb19d7b-4b42-4f3f-892f-1cbeebbc683e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:14.697306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb19d7b-4b42-4f3f-892f-1cbeebbc683e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:14.702115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381efd9c-51e9-4490-a0ee-790b91d93206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:14.703009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efd9c-51e9-4490-a0ee-790b91d93206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.703327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efd9c-51e9-4490-a0ee-790b91d93206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.703615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efd9c-51e9-4490-a0ee-790b91d93206 admin admin] PATH_INFO: `/v3/projects/8870c5ccecbc4391b5dd65caa563be82/users/bdb28a9a7be54d22a572a37e3a57deb4/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.719004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381efd9c-51e9-4490-a0ee-790b91d93206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8870c5ccecbc4391b5dd65caa563be82, user_id=bdb28a9a7be54d22a572a37e3a57deb4, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:14.722002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381efd9c-51e9-4490-a0ee-790b91d93206 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:14.741232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1196/2368] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:35:14 2022] PUT /identity/v3/projects/8870c5ccecbc4391b5dd65caa563be82/users/bdb28a9a7be54d22a572a37e3a57deb4/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:35:14.752636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37a1c5-8553-4a2c-82b3-63c4681f708d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.752921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37a1c5-8553-4a2c-82b3-63c4681f708d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.753192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37a1c5-8553-4a2c-82b3-63c4681f708d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.781564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5f37a1c5-8553-4a2c-82b3-63c4681f708d None None] MFA Rules not processed for user `bdb28a9a7be54d22a572a37e3a57deb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:14.782786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5f37a1c5-8553-4a2c-82b3-63c4681f708d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:14.851526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1173/2369] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:14.864496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381efd9c-51e9-4490-a0ee-790b91d93206 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:14.866400 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-381efd9c-51e9-4490-a0ee-790b91d93206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:14.927965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381efd9c-51e9-4490-a0ee-790b91d93206 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:14.931619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0322b-d355-4fcf-abf9-71f92114adc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:14.932236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0322b-d355-4fcf-abf9-71f92114adc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:14.932562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0322b-d355-4fcf-abf9-71f92114adc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:14.932835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0322b-d355-4fcf-abf9-71f92114adc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:14.941654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0322b-d355-4fcf-abf9-71f92114adc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:14.943120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0322b-d355-4fcf-abf9-71f92114adc5 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:14.952418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1197/2370] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:35:24.848853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:24.948057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=5,keystone:SELECT=64,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:25.292447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76515898-3cab-4ac2-a313-25e891bf7009 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:25.292739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76515898-3cab-4ac2-a313-25e891bf7009 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:25.293020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76515898-3cab-4ac2-a313-25e891bf7009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:25.339004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-76515898-3cab-4ac2-a313-25e891bf7009 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:25.346219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-76515898-3cab-4ac2-a313-25e891bf7009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:25.500020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1174/2371] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:25.532806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0322b-d355-4fcf-abf9-71f92114adc5 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:25.534312 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1aa0322b-d355-4fcf-abf9-71f92114adc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:25.696259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0322b-d355-4fcf-abf9-71f92114adc5 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:25.713746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e25d8-b504-47ea-b4b2-f17320aefa22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:25.715033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e25d8-b504-47ea-b4b2-f17320aefa22 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:25.716523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e25d8-b504-47ea-b4b2-f17320aefa22 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:25.718496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e25d8-b504-47ea-b4b2-f17320aefa22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:25.727475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76515898-3cab-4ac2-a313-25e891bf7009 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:25.729576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-76515898-3cab-4ac2-a313-25e891bf7009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:25.758286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e25d8-b504-47ea-b4b2-f17320aefa22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:25.760788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76515898-3cab-4ac2-a313-25e891bf7009 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:25.762616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e25d8-b504-47ea-b4b2-f17320aefa22 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:25.780846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:25.781831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:25.782244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:25.782733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] PATH_INFO: `/v3/users/ebf791343bac4436a8e562db621e2209` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:25.785710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf791343bac4436a8e562db621e2209)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:25.787907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:25.797412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1198/2372] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:35:25.855387 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ed451-d6b8-41fa-b8e4-5e2e952da71f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:25.855879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ed451-d6b8-41fa-b8e4-5e2e952da71f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:25.856217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ed451-d6b8-41fa-b8e4-5e2e952da71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:25.892003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1b5ed451-d6b8-41fa-b8e4-5e2e952da71f None None] MFA Rules not processed for user `deea84058f724ff3b78caa9d8b010202`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:25.893338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1b5ed451-d6b8-41fa-b8e4-5e2e952da71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:25.957008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf791343bac4436a8e562db621e2209'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:25.959063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf791343bac4436a8e562db621e2209'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:25.974651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf791343bac4436a8e562db621e2209'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:25.975398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1199/2373] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:35:25.992238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf791343bac4436a8e562db621e2209'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:25.999621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf791343bac4436a8e562db621e2209'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:26.006171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1175/2374] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:35:25 2022] DELETE /identity/v3/users/ebf791343bac4436a8e562db621e2209 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:35:26.010406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770acf12-f2f3-4c9c-98f5-eb2a33909378 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:26.010680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770acf12-f2f3-4c9c-98f5-eb2a33909378 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:26.010949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770acf12-f2f3-4c9c-98f5-eb2a33909378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:26.034292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-770acf12-f2f3-4c9c-98f5-eb2a33909378 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:26.035917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-770acf12-f2f3-4c9c-98f5-eb2a33909378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:26.117809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1200/2375] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:26.129283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:26.132072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:26.230084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902952d-1822-4738-a602-3c84da2d6661 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:26.234171 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29e9e7-aa09-40d4-a26f-dcd8f631bbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:26.234793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29e9e7-aa09-40d4-a26f-dcd8f631bbae service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:26.235097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29e9e7-aa09-40d4-a26f-dcd8f631bbae service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:26.235361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29e9e7-aa09-40d4-a26f-dcd8f631bbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:26.246317 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29e9e7-aa09-40d4-a26f-dcd8f631bbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:26.249038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29e9e7-aa09-40d4-a26f-dcd8f631bbae service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:26.262925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1176/2376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:35:26.917836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770acf12-f2f3-4c9c-98f5-eb2a33909378 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:26.919407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-770acf12-f2f3-4c9c-98f5-eb2a33909378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:26.932376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770acf12-f2f3-4c9c-98f5-eb2a33909378 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:26.938762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:26.940136 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:26.940417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:26.940690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] PATH_INFO: `/v3/projects/ad5eb7e9c05f46338e45816313132c07` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:26.942346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5eb7e9c05f46338e45816313132c07)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:26.944499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:26.984325 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:27.013210 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5eb7e9c05f46338e45816313132c07', 'request_id': 'req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:27.023875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5eb7e9c05f46338e45816313132c07', 'request_id': 'req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:27.032075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5eb7e9c05f46338e45816313132c07', 'request_id': 'req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:27.046729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] The token cache is being invalidate because project ad5eb7e9c05f46338e45816313132c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:35:27.047206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:27.048128 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0d7fc88f-e1fe-477b-95a7-1e4fdec587f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:27.050070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1201/2377] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:35:26 2022] DELETE /identity/v3/projects/ad5eb7e9c05f46338e45816313132c07 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:35:27.055700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da544-b376-48b1-8dbf-6117a7580026 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:27.056300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da544-b376-48b1-8dbf-6117a7580026 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:27.056544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da544-b376-48b1-8dbf-6117a7580026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:27.090851 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f80da544-b376-48b1-8dbf-6117a7580026 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:27.092114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f80da544-b376-48b1-8dbf-6117a7580026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:27.105038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:27.327566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1177/2378] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:27.338584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0b9ed-bae9-408c-a86c-16a0dc67ec23 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:27.338939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0b9ed-bae9-408c-a86c-16a0dc67ec23 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:27.339381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0b9ed-bae9-408c-a86c-16a0dc67ec23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:27.360344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1bd0b9ed-bae9-408c-a86c-16a0dc67ec23 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:27.361805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1bd0b9ed-bae9-408c-a86c-16a0dc67ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:27.374140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1202/2379] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:27.376829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80da544-b376-48b1-8dbf-6117a7580026 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:27.388236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80da544-b376-48b1-8dbf-6117a7580026 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:27.393315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b7176-4fd5-4bf5-acde-0f507ed4b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:27.393929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b7176-4fd5-4bf5-acde-0f507ed4b299 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:27.394234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b7176-4fd5-4bf5-acde-0f507ed4b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:27.394538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b7176-4fd5-4bf5-acde-0f507ed4b299 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:27.395145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b7176-4fd5-4bf5-acde-0f507ed4b299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:35:27.395490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b7176-4fd5-4bf5-acde-0f507ed4b299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:27.397415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b7176-4fd5-4bf5-acde-0f507ed4b299 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:27.411438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1178/2380] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:35:27.415609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0b9ed-bae9-408c-a86c-16a0dc67ec23 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:27.426627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0b9ed-bae9-408c-a86c-16a0dc67ec23 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:27.431582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e672b-3ce6-4d99-90ce-399ddffbd6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:27.432207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e672b-3ce6-4d99-90ce-399ddffbd6cc admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:27.432481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e672b-3ce6-4d99-90ce-399ddffbd6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:27.432746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e672b-3ce6-4d99-90ce-399ddffbd6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:27.433389 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e672b-3ce6-4d99-90ce-399ddffbd6cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:27.435286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e672b-3ce6-4d99-90ce-399ddffbd6cc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:27.468634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1203/2381] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:35:27 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:35:27.473225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b7176-4fd5-4bf5-acde-0f507ed4b299 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:27.485311 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b7176-4fd5-4bf5-acde-0f507ed4b299 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:27.545564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ca3f-cce3-4545-89e2-1c7aa35ed8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:27.546192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ca3f-cce3-4545-89e2-1c7aa35ed8ca admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:27.546522 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ca3f-cce3-4545-89e2-1c7aa35ed8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:27.546732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ca3f-cce3-4545-89e2-1c7aa35ed8ca admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:27.547555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8ca3f-cce3-4545-89e2-1c7aa35ed8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:27.549694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8ca3f-cce3-4545-89e2-1c7aa35ed8ca admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:27.572711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1179/2382] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:35:27 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:35:27.638065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e672b-3ce6-4d99-90ce-399ddffbd6cc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:27.655811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e672b-3ce6-4d99-90ce-399ddffbd6cc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:27.661988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39101ef8-5209-4893-8265-f733278c0cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:27.662609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39101ef8-5209-4893-8265-f733278c0cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:27.662889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39101ef8-5209-4893-8265-f733278c0cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:27.663157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39101ef8-5209-4893-8265-f733278c0cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:27.663897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39101ef8-5209-4893-8265-f733278c0cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:27.665576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39101ef8-5209-4893-8265-f733278c0cdb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:27.676970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1204/2383] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:35:27.681251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ca3f-cce3-4545-89e2-1c7aa35ed8ca admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:27.692047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ca3f-cce3-4545-89e2-1c7aa35ed8ca admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:27.697331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a0f05-5a42-4ebe-bc92-416cc846f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:27.697941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a0f05-5a42-4ebe-bc92-416cc846f3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:27.698182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a0f05-5a42-4ebe-bc92-416cc846f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:27.698440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a0f05-5a42-4ebe-bc92-416cc846f3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:27.699076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a0f05-5a42-4ebe-bc92-416cc846f3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:27.700725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a0f05-5a42-4ebe-bc92-416cc846f3c4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:27.714022 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1180/2384] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:35:27.716978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39101ef8-5209-4893-8265-f733278c0cdb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:27.727670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39101ef8-5209-4893-8265-f733278c0cdb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:27.732447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76bfb-9c16-423e-8215-2a510e694ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:27.733107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76bfb-9c16-423e-8215-2a510e694ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:27.733379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76bfb-9c16-423e-8215-2a510e694ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:27.733646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76bfb-9c16-423e-8215-2a510e694ca2 admin admin] PATH_INFO: `/v3/projects/448ace02dc2f4bb7b9f979955f47236c/users/9ec120f2c0bc4c7b8e761479be17576a/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:27.748840 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76bfb-9c16-423e-8215-2a510e694ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448ace02dc2f4bb7b9f979955f47236c, user_id=9ec120f2c0bc4c7b8e761479be17576a, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:27.753334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76bfb-9c16-423e-8215-2a510e694ca2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:27.768650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1205/2385] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:35:27 2022] PUT /identity/v3/projects/448ace02dc2f4bb7b9f979955f47236c/users/9ec120f2c0bc4c7b8e761479be17576a/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:35:27.779376 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad7fb2-a1ac-4cfb-8150-17ca998bc93b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:27.779737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad7fb2-a1ac-4cfb-8150-17ca998bc93b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:27.780034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad7fb2-a1ac-4cfb-8150-17ca998bc93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:27.811037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-71ad7fb2-a1ac-4cfb-8150-17ca998bc93b None None] MFA Rules not processed for user `9ec120f2c0bc4c7b8e761479be17576a`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:27.812277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-71ad7fb2-a1ac-4cfb-8150-17ca998bc93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:27.891277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1181/2386] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:27.903919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76bfb-9c16-423e-8215-2a510e694ca2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:27.906105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ddd76bfb-9c16-423e-8215-2a510e694ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:27.994612 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76bfb-9c16-423e-8215-2a510e694ca2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:28.000345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4c607-032f-4138-8511-48e8b8ba648d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:28.001155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4c607-032f-4138-8511-48e8b8ba648d service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:28.001663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4c607-032f-4138-8511-48e8b8ba648d service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:28.001939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4c607-032f-4138-8511-48e8b8ba648d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:28.013644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4c607-032f-4138-8511-48e8b8ba648d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:28.015200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4c607-032f-4138-8511-48e8b8ba648d service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:28.024694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1206/2387] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:35:29.078299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad7fb2-a1ac-4cfb-8150-17ca998bc93b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:29.081067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-71ad7fb2-a1ac-4cfb-8150-17ca998bc93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:29.100400 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:29.161245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad7fb2-a1ac-4cfb-8150-17ca998bc93b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:29.166682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:29.167325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:29.167615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:29.167875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] PATH_INFO: `/v3/users/bdb28a9a7be54d22a572a37e3a57deb4` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:29.169037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb28a9a7be54d22a572a37e3a57deb4)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:29.170935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:29.221259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb28a9a7be54d22a572a37e3a57deb4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:29.221984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb28a9a7be54d22a572a37e3a57deb4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:29.233876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb28a9a7be54d22a572a37e3a57deb4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:29.246608 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb28a9a7be54d22a572a37e3a57deb4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:29.253800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb28a9a7be54d22a572a37e3a57deb4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:29.261048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1182/2388] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:35:29 2022] DELETE /identity/v3/users/bdb28a9a7be54d22a572a37e3a57deb4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:35:29.265665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63af31-f1c5-4729-96f7-3b8f9dbdf20c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:29.266156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63af31-f1c5-4729-96f7-3b8f9dbdf20c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:29.266252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63af31-f1c5-4729-96f7-3b8f9dbdf20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:29.285191 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6f63af31-f1c5-4729-96f7-3b8f9dbdf20c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:29.286376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6f63af31-f1c5-4729-96f7-3b8f9dbdf20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:29.340107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:29.354855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1207/2389] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:29.365262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:29.366946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:29.431840 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee8801-9b87-477f-9781-2f79d3e6d253 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:29.435592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7b001-a19c-4d25-9437-895e15cb8622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:29.436211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7b001-a19c-4d25-9437-895e15cb8622 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:29.436484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7b001-a19c-4d25-9437-895e15cb8622 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:29.436753 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7b001-a19c-4d25-9437-895e15cb8622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:29.444822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1355f48-eab0-4e43-8d7a-35e6c485a377 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:29.445107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1355f48-eab0-4e43-8d7a-35e6c485a377 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:29.445383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1355f48-eab0-4e43-8d7a-35e6c485a377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:29.448341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7b001-a19c-4d25-9437-895e15cb8622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:29.449804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7b001-a19c-4d25-9437-895e15cb8622 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:29.460321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1183/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:35:29.467471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e1355f48-eab0-4e43-8d7a-35e6c485a377 None None] MFA Rules not processed for user `9ec120f2c0bc4c7b8e761479be17576a`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:29.468680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e1355f48-eab0-4e43-8d7a-35e6c485a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:29.625884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1208/2391] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:35:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:35:30.054626 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7b001-a19c-4d25-9437-895e15cb8622 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:30.056919 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7fe7b001-a19c-4d25-9437-895e15cb8622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:30.071256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7b001-a19c-4d25-9437-895e15cb8622 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:30.076832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:30.077505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:30.077780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:30.078050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] PATH_INFO: `/v3/projects/8870c5ccecbc4391b5dd65caa563be82` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:30.079232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8870c5ccecbc4391b5dd65caa563be82)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:30.081201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:30.129754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:30.149395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8870c5ccecbc4391b5dd65caa563be82', 'request_id': 'req-d0b83b69-da08-46ed-8b7f-c000390ffcdc'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:30.157672 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8870c5ccecbc4391b5dd65caa563be82', 'request_id': 'req-d0b83b69-da08-46ed-8b7f-c000390ffcdc'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:30.163757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8870c5ccecbc4391b5dd65caa563be82', 'request_id': 'req-d0b83b69-da08-46ed-8b7f-c000390ffcdc'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:30.176883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] The token cache is being invalidate because project 8870c5ccecbc4391b5dd65caa563be82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:35:30.177255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:30.178250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:35:30.183407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1184/2392] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:35:30 2022] DELETE /identity/v3/projects/8870c5ccecbc4391b5dd65caa563be82 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:35:31.572739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e353d3-20ea-4913-807a-2eb5c7f0565a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:31.573291 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e353d3-20ea-4913-807a-2eb5c7f0565a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:31.573409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e353d3-20ea-4913-807a-2eb5c7f0565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:31.593173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a7e353d3-20ea-4913-807a-2eb5c7f0565a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:31.594380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a7e353d3-20ea-4913-807a-2eb5c7f0565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:31.664439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1209/2393] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:31.699645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:31.701183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:31.784372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83b69-da08-46ed-8b7f-c000390ffcdc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:31.790259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f61ec-4a13-4e2c-8340-3bf13c470829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:31.790865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f61ec-4a13-4e2c-8340-3bf13c470829 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:31.791143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f61ec-4a13-4e2c-8340-3bf13c470829 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:31.791426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f61ec-4a13-4e2c-8340-3bf13c470829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:31.799927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f61ec-4a13-4e2c-8340-3bf13c470829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:31.801527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f61ec-4a13-4e2c-8340-3bf13c470829 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:31.812905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1185/2394] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:35:38.240405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158ce3a-cf42-4898-9ecc-09eebd44d165 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:38.241583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158ce3a-cf42-4898-9ecc-09eebd44d165 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:38.241833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158ce3a-cf42-4898-9ecc-09eebd44d165 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:38.243188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1210/2395] 10.222.0.20 () {54 vars in 961 bytes} [Thu Oct 6 04:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:35:38.253027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454dcb7-1c4b-4cee-b8df-29baa8a88b31 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:38.253545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454dcb7-1c4b-4cee-b8df-29baa8a88b31 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:38.253545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454dcb7-1c4b-4cee-b8df-29baa8a88b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:38.276658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9454dcb7-1c4b-4cee-b8df-29baa8a88b31 None None] MFA Rules not processed for user `ff4e48fdc18e424fa2cf80fd5da332b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:38.277896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9454dcb7-1c4b-4cee-b8df-29baa8a88b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:38.344290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1186/2396] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Oct 6 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:38.352756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158ce3a-cf42-4898-9ecc-09eebd44d165 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:38.366315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158ce3a-cf42-4898-9ecc-09eebd44d165 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:38.377395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadccbe-0678-4e8a-a651-dcde7543f65f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:38.377943 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadccbe-0678-4e8a-a651-dcde7543f65f service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:38.378214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadccbe-0678-4e8a-a651-dcde7543f65f service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:38.378478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadccbe-0678-4e8a-a651-dcde7543f65f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:38.380462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0eadccbe-0678-4e8a-a651-dcde7543f65f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:38.393243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadccbe-0678-4e8a-a651-dcde7543f65f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:38.394888 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadccbe-0678-4e8a-a651-dcde7543f65f service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:38.405770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1211/2397] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:35:39.052018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63262-af52-4842-9192-1697c219fe6f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:39.052345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63262-af52-4842-9192-1697c219fe6f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:39.052661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63262-af52-4842-9192-1697c219fe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:39.073936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-def63262-af52-4842-9192-1697c219fe6f None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:39.075290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-def63262-af52-4842-9192-1697c219fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:39.087568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1187/2398] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:35:39.114724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadccbe-0678-4e8a-a651-dcde7543f65f service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:39.138381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadccbe-0678-4e8a-a651-dcde7543f65f service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:39.143860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05978646-50d4-4a1f-b5b7-3548f2b531bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:39.144749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978646-50d4-4a1f-b5b7-3548f2b531bc service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:39.145188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978646-50d4-4a1f-b5b7-3548f2b531bc service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:39.145456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978646-50d4-4a1f-b5b7-3548f2b531bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:39.156889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05978646-50d4-4a1f-b5b7-3548f2b531bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:39.159015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05978646-50d4-4a1f-b5b7-3548f2b531bc service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:39.174835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1212/2399] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:35:41.913709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63262-af52-4842-9192-1697c219fe6f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:41.916349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-def63262-af52-4842-9192-1697c219fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:41.951850 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:41.976732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63262-af52-4842-9192-1697c219fe6f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:41.980446 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717dad2-64b3-45c2-bacb-99dba4d07659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:41.981056 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717dad2-64b3-45c2-bacb-99dba4d07659 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:41.981330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717dad2-64b3-45c2-bacb-99dba4d07659 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:41.981595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717dad2-64b3-45c2-bacb-99dba4d07659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:41.983387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0717dad2-64b3-45c2-bacb-99dba4d07659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:42.048303 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717dad2-64b3-45c2-bacb-99dba4d07659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:42.049803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717dad2-64b3-45c2-bacb-99dba4d07659 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:42.060853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1188/2400] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:35:46.291284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b65ab-8a08-49d9-95a8-b55deb779eba None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:46.292397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b65ab-8a08-49d9-95a8-b55deb779eba None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:46.292397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b65ab-8a08-49d9-95a8-b55deb779eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:46.317392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fa9b65ab-8a08-49d9-95a8-b55deb779eba None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:46.319116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fa9b65ab-8a08-49d9-95a8-b55deb779eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:46.327498 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1213/2401] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:35:46.358179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717dad2-64b3-45c2-bacb-99dba4d07659 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:46.372180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717dad2-64b3-45c2-bacb-99dba4d07659 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:46.379129 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b36ac-b468-422e-b3f3-4ab254a50d35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:46.379780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b36ac-b468-422e-b3f3-4ab254a50d35 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:46.380028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b36ac-b468-422e-b3f3-4ab254a50d35 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:46.380325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b36ac-b468-422e-b3f3-4ab254a50d35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:46.389422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b36ac-b468-422e-b3f3-4ab254a50d35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:46.391086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b36ac-b468-422e-b3f3-4ab254a50d35 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:46.401126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1189/2402] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:35:55.629738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d77c2-cd7e-4b0d-bfa9-e0710df71c07 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:55.630280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d77c2-cd7e-4b0d-bfa9-e0710df71c07 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:55.630679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d77c2-cd7e-4b0d-bfa9-e0710df71c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:55.652163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-729d77c2-cd7e-4b0d-bfa9-e0710df71c07 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:35:55.653470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-729d77c2-cd7e-4b0d-bfa9-e0710df71c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:55.665004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1214/2403] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:35:55.689534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b36ac-b468-422e-b3f3-4ab254a50d35 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:35:55.694106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c04b36ac-b468-422e-b3f3-4ab254a50d35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:35:55.710145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b36ac-b468-422e-b3f3-4ab254a50d35 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:35:55.715913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfc15e-93d7-410e-aaf9-273555e7ed1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:35:55.716550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfc15e-93d7-410e-aaf9-273555e7ed1d service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:35:55.718188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfc15e-93d7-410e-aaf9-273555e7ed1d service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:35:55.718467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfc15e-93d7-410e-aaf9-273555e7ed1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:35:55.727604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfc15e-93d7-410e-aaf9-273555e7ed1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:35:55.729389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfc15e-93d7-410e-aaf9-273555e7ed1d service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:35:55.740567 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1190/2404] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:36:01.917167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250c3cb-3bbf-4046-a7d4-e17f09b7eacc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:01.917610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250c3cb-3bbf-4046-a7d4-e17f09b7eacc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:01.917705 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250c3cb-3bbf-4046-a7d4-e17f09b7eacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:01.926280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=74 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:01.940634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d250c3cb-3bbf-4046-a7d4-e17f09b7eacc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:01.941845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d250c3cb-3bbf-4046-a7d4-e17f09b7eacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:01.951185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1215/2405] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:01.979461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfc15e-93d7-410e-aaf9-273555e7ed1d service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:01.992114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfc15e-93d7-410e-aaf9-273555e7ed1d service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:01.999799 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c0ba2-944e-4022-a310-e184f74a26d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:02.000392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c0ba2-944e-4022-a310-e184f74a26d0 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:02.000668 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c0ba2-944e-4022-a310-e184f74a26d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:02.000934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c0ba2-944e-4022-a310-e184f74a26d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:02.009409 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c0ba2-944e-4022-a310-e184f74a26d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:02.010987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c0ba2-944e-4022-a310-e184f74a26d0 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:02.020685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1191/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:36:07.088690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017d59-f1b8-4851-a854-8e06d6d22b51 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:07.089185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017d59-f1b8-4851-a854-8e06d6d22b51 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:07.089306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017d59-f1b8-4851-a854-8e06d6d22b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:07.109806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8e017d59-f1b8-4851-a854-8e06d6d22b51 None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:07.111022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8e017d59-f1b8-4851-a854-8e06d6d22b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:07.168202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1216/2407] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:36:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:36:07.191503 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c0ba2-944e-4022-a310-e184f74a26d0 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:07.193538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a99c0ba2-944e-4022-a310-e184f74a26d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:07.264739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c0ba2-944e-4022-a310-e184f74a26d0 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:07.269888 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992d13e-6f16-4b41-a207-7e47eed1238b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:07.270494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d13e-6f16-4b41-a207-7e47eed1238b service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:07.270777 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d13e-6f16-4b41-a207-7e47eed1238b service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:07.271043 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d13e-6f16-4b41-a207-7e47eed1238b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:07.279168 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992d13e-6f16-4b41-a207-7e47eed1238b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:07.280772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992d13e-6f16-4b41-a207-7e47eed1238b service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:07.288746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1192/2408] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:36:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:36:07.848555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007fe1f-d31c-4e8d-b934-5fa8d71c303d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:07.848905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007fe1f-d31c-4e8d-b934-5fa8d71c303d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:07.849271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007fe1f-d31c-4e8d-b934-5fa8d71c303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:07.869252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3007fe1f-d31c-4e8d-b934-5fa8d71c303d None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:07.870541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3007fe1f-d31c-4e8d-b934-5fa8d71c303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:07.881894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1217/2409] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 6 04:36:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:07.898164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992d13e-6f16-4b41-a207-7e47eed1238b service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:07.909070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992d13e-6f16-4b41-a207-7e47eed1238b service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:07.914758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6e6ea-0a61-4c8d-a631-ec9f40e89284 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:07.915445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e6ea-0a61-4c8d-a631-ec9f40e89284 service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:07.915717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e6ea-0a61-4c8d-a631-ec9f40e89284 service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:07.915986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e6ea-0a61-4c8d-a631-ec9f40e89284 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:07.924173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6e6ea-0a61-4c8d-a631-ec9f40e89284 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:07.925786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6e6ea-0a61-4c8d-a631-ec9f40e89284 service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:07.933733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1193/2410] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:36:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:36:08.183546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd624095-8f89-4df6-9b6b-64e74e4db618 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:08.184093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd624095-8f89-4df6-9b6b-64e74e4db618 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:08.184093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd624095-8f89-4df6-9b6b-64e74e4db618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:08.205662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dd624095-8f89-4df6-9b6b-64e74e4db618 None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:08.206891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dd624095-8f89-4df6-9b6b-64e74e4db618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:08.215048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1218/2411] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:36:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:08.227938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6e6ea-0a61-4c8d-a631-ec9f40e89284 service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:08.239289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6e6ea-0a61-4c8d-a631-ec9f40e89284 service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:08.244891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6bb77-aacf-46e4-9cb1-8655fc7fb8d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:08.245507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6bb77-aacf-46e4-9cb1-8655fc7fb8d0 service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:08.245773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6bb77-aacf-46e4-9cb1-8655fc7fb8d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:08.246040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6bb77-aacf-46e4-9cb1-8655fc7fb8d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:08.254460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6bb77-aacf-46e4-9cb1-8655fc7fb8d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:08.256063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6bb77-aacf-46e4-9cb1-8655fc7fb8d0 service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:08.265957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1194/2412] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:36:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:36:08.630242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010c4a-e09b-4633-aa2d-4a2506d42e73 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:08.630589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010c4a-e09b-4633-aa2d-4a2506d42e73 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:08.630937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010c4a-e09b-4633-aa2d-4a2506d42e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:08.650716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-57010c4a-e09b-4633-aa2d-4a2506d42e73 None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:08.652037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57010c4a-e09b-4633-aa2d-4a2506d42e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:08.659860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1219/2413] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 6 04:36:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:08.673543 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6bb77-aacf-46e4-9cb1-8655fc7fb8d0 service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:08.683860 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:08.688433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6bb77-aacf-46e4-9cb1-8655fc7fb8d0 service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:08.694105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e8cb-fac9-4b6e-b881-6f982ca15277 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:08.694891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e8cb-fac9-4b6e-b881-6f982ca15277 service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:08.695166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e8cb-fac9-4b6e-b881-6f982ca15277 service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:08.695471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e8cb-fac9-4b6e-b881-6f982ca15277 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:08.703885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70e8cb-fac9-4b6e-b881-6f982ca15277 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:08.705479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70e8cb-fac9-4b6e-b881-6f982ca15277 service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:08.714667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1195/2414] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:36:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:36:10.856819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57010c4a-e09b-4633-aa2d-4a2506d42e73 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:10.859457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57010c4a-e09b-4633-aa2d-4a2506d42e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:10.880500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57010c4a-e09b-4633-aa2d-4a2506d42e73 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:10.886245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:10.886928 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:10.887205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:10.887502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] PATH_INFO: `/v3/users/9ec120f2c0bc4c7b8e761479be17576a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:10.888703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec120f2c0bc4c7b8e761479be17576a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:10.890586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:10.945750 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec120f2c0bc4c7b8e761479be17576a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:36:10.955035 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec120f2c0bc4c7b8e761479be17576a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:36:10.968091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec120f2c0bc4c7b8e761479be17576a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:36:10.969029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec120f2c0bc4c7b8e761479be17576a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:36:10.976528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec120f2c0bc4c7b8e761479be17576a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:36:10.983157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1220/2415] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:36:10 2022] DELETE /identity/v3/users/9ec120f2c0bc4c7b8e761479be17576a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:36:10.988116 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702ec0-33f7-45cf-be7f-620a126da04d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:10.988603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702ec0-33f7-45cf-be7f-620a126da04d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:10.988603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702ec0-33f7-45cf-be7f-620a126da04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:11.008575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ba702ec0-33f7-45cf-be7f-620a126da04d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:11.009762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ba702ec0-33f7-45cf-be7f-620a126da04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:11.073298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1196/2416] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:11.083616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:11.085338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:11.145685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e07f4b-75b7-4d73-a4ff-5afb5897cd08 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:11.149271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b822e-6555-461a-bf9c-1394e5b754f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:11.149889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b822e-6555-461a-bf9c-1394e5b754f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:11.150161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b822e-6555-461a-bf9c-1394e5b754f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:11.150431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b822e-6555-461a-bf9c-1394e5b754f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:11.157329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:11.159951 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b822e-6555-461a-bf9c-1394e5b754f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:11.161710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b822e-6555-461a-bf9c-1394e5b754f0 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:11.173154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1221/2417] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:36:11.347505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702ec0-33f7-45cf-be7f-620a126da04d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:11.348999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ba702ec0-33f7-45cf-be7f-620a126da04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:11.361690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702ec0-33f7-45cf-be7f-620a126da04d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:11.367009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:11.367785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:11.368140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:11.368416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] PATH_INFO: `/v3/projects/448ace02dc2f4bb7b9f979955f47236c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:11.369541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=448ace02dc2f4bb7b9f979955f47236c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:11.371445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:11.418939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448ace02dc2f4bb7b9f979955f47236c', 'request_id': 'req-34084f9d-57b8-498d-9c38-ace0d2c07494'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:36:11.427289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448ace02dc2f4bb7b9f979955f47236c', 'request_id': 'req-34084f9d-57b8-498d-9c38-ace0d2c07494'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:36:11.433110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448ace02dc2f4bb7b9f979955f47236c', 'request_id': 'req-34084f9d-57b8-498d-9c38-ace0d2c07494'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:36:11.444274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] The token cache is being invalidate because project 448ace02dc2f4bb7b9f979955f47236c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:36:11.444561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:36:11.445275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-34084f9d-57b8-498d-9c38-ace0d2c07494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:36:11.446851 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1197/2418] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:36:11 2022] DELETE /identity/v3/projects/448ace02dc2f4bb7b9f979955f47236c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:36:20.611348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70584d3-0337-4f6b-86c5-e498716b9ea5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:20.611909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70584d3-0337-4f6b-86c5-e498716b9ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:20.611909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70584d3-0337-4f6b-86c5-e498716b9ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:20.632506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f70584d3-0337-4f6b-86c5-e498716b9ea5 None None] MFA Rules not processed for user `fe0862d2f6694be5b4ef0d760a55d10d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:20.633742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f70584d3-0337-4f6b-86c5-e498716b9ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:20.693212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1222/2419] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:36:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:21.441179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:30.685409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=27 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:35.963263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f305659-df6c-4728-9b8b-e13276517edf None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:35.963891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f305659-df6c-4728-9b8b-e13276517edf None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:35.963891 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f305659-df6c-4728-9b8b-e13276517edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:35.985229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4f305659-df6c-4728-9b8b-e13276517edf None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:35.986426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4f305659-df6c-4728-9b8b-e13276517edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:36.049673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1198/2420] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:36.072042 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70584d3-0337-4f6b-86c5-e498716b9ea5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:36.073580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f70584d3-0337-4f6b-86c5-e498716b9ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:36.151650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70584d3-0337-4f6b-86c5-e498716b9ea5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:36.157743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf984b-ac89-44d7-9e24-00ab97cb5e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:36.158353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf984b-ac89-44d7-9e24-00ab97cb5e4d service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:36.158608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf984b-ac89-44d7-9e24-00ab97cb5e4d service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:36.158886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf984b-ac89-44d7-9e24-00ab97cb5e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:36.167772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf984b-ac89-44d7-9e24-00ab97cb5e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:36.169349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf984b-ac89-44d7-9e24-00ab97cb5e4d service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:36.179341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1223/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:36:40.281676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c394b-4fa7-45ff-87ce-67ae5ced1e38 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:40.282272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c394b-4fa7-45ff-87ce-67ae5ced1e38 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:40.282272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c394b-4fa7-45ff-87ce-67ae5ced1e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:40.304598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7a7c394b-4fa7-45ff-87ce-67ae5ced1e38 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:40.305759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7a7c394b-4fa7-45ff-87ce-67ae5ced1e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:40.315207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1199/2422] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:40.342173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf984b-ac89-44d7-9e24-00ab97cb5e4d service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:40.343795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-afdf984b-ac89-44d7-9e24-00ab97cb5e4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:40.359260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf984b-ac89-44d7-9e24-00ab97cb5e4d service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:40.365766 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c188d5-ec31-485a-9d24-108115f2bad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:40.366369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c188d5-ec31-485a-9d24-108115f2bad8 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:40.366646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c188d5-ec31-485a-9d24-108115f2bad8 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:40.366916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c188d5-ec31-485a-9d24-108115f2bad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:40.375601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c188d5-ec31-485a-9d24-108115f2bad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:40.377240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c188d5-ec31-485a-9d24-108115f2bad8 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:40.388438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1224/2423] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:36:44.402404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac68bd-edf9-4bb7-8e2e-51ecaed3a69c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:44.402921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac68bd-edf9-4bb7-8e2e-51ecaed3a69c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:44.402921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac68bd-edf9-4bb7-8e2e-51ecaed3a69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:44.425965 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b2ac68bd-edf9-4bb7-8e2e-51ecaed3a69c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:44.427292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b2ac68bd-edf9-4bb7-8e2e-51ecaed3a69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:44.437504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1200/2424] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:44.461102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c188d5-ec31-485a-9d24-108115f2bad8 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:44.473187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c188d5-ec31-485a-9d24-108115f2bad8 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:44.480229 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272942a-c755-4dd3-8a91-b2d2ad0d4ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:44.480826 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272942a-c755-4dd3-8a91-b2d2ad0d4ad2 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:44.481121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272942a-c755-4dd3-8a91-b2d2ad0d4ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:44.481355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272942a-c755-4dd3-8a91-b2d2ad0d4ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:44.490410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272942a-c755-4dd3-8a91-b2d2ad0d4ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:44.492074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272942a-c755-4dd3-8a91-b2d2ad0d4ad2 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:44.502321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1225/2425] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:36:48.644882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea2dc0-e99e-4d1b-92df-58ed93e7e7e1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:48.645749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea2dc0-e99e-4d1b-92df-58ed93e7e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:48.645749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea2dc0-e99e-4d1b-92df-58ed93e7e7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:48.677502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-25ea2dc0-e99e-4d1b-92df-58ed93e7e7e1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:48.678710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-25ea2dc0-e99e-4d1b-92df-58ed93e7e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:48.687932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1201/2426] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:48.722726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272942a-c755-4dd3-8a91-b2d2ad0d4ad2 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:48.734513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272942a-c755-4dd3-8a91-b2d2ad0d4ad2 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:48.741314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfbed8-20d6-497b-9846-318d2c59493c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:48.741909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfbed8-20d6-497b-9846-318d2c59493c service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:48.742212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfbed8-20d6-497b-9846-318d2c59493c service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:48.742481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfbed8-20d6-497b-9846-318d2c59493c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:48.750871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfbed8-20d6-497b-9846-318d2c59493c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:48.752536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfbed8-20d6-497b-9846-318d2c59493c service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:48.762015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1226/2427] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:36:53.899462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0bd8d-6b3a-4b6f-9997-767cac1fb020 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:53.900001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0bd8d-6b3a-4b6f-9997-767cac1fb020 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:53.900001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0bd8d-6b3a-4b6f-9997-767cac1fb020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:53.921270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-63f0bd8d-6b3a-4b6f-9997-767cac1fb020 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:36:53.922463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-63f0bd8d-6b3a-4b6f-9997-767cac1fb020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:36:53.931987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1202/2428] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 6 04:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:36:53.968708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfbed8-20d6-497b-9846-318d2c59493c service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:36:53.980648 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfbed8-20d6-497b-9846-318d2c59493c service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:36:53.988665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dd53f-9224-451d-9772-f9e3c428265d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:36:53.989287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dd53f-9224-451d-9772-f9e3c428265d service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:36:53.989563 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dd53f-9224-451d-9772-f9e3c428265d service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:36:53.989822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dd53f-9224-451d-9772-f9e3c428265d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:36:53.998999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dd53f-9224-451d-9772-f9e3c428265d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:36:54.000628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dd53f-9224-451d-9772-f9e3c428265d service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:36:54.010984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1227/2429] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:37:03.916109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=39 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:04.006351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=58 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:20.580432 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6911c-e8f9-476f-a7ac-78d438f7c398 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:20.581028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6911c-e8f9-476f-a7ac-78d438f7c398 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:20.581028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6911c-e8f9-476f-a7ac-78d438f7c398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:20.601750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-41c6911c-e8f9-476f-a7ac-78d438f7c398 None None] MFA Rules not processed for user `3b8b820bb8ad4599837afad008daf413`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:37:20.602926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-41c6911c-e8f9-476f-a7ac-78d438f7c398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:20.669124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1203/2430] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:37:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:37:28.594442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dd53f-9224-451d-9772-f9e3c428265d service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:28.596008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7b8dd53f-9224-451d-9772-f9e3c428265d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:28.609646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dd53f-9224-451d-9772-f9e3c428265d service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:28.614626 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:28.615264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:28.615564 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:28.615831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] PATH_INFO: `/v3/users/fe0862d2f6694be5b4ef0d760a55d10d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:28.616946 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe0862d2f6694be5b4ef0d760a55d10d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:28.618863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:28.668072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe0862d2f6694be5b4ef0d760a55d10d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:28.676621 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe0862d2f6694be5b4ef0d760a55d10d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:28.688485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe0862d2f6694be5b4ef0d760a55d10d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:28.689112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe0862d2f6694be5b4ef0d760a55d10d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:28.695916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44ef652e-688a-4972-aa38-808de1fe4e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe0862d2f6694be5b4ef0d760a55d10d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:28.701646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1228/2431] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:37:28 2022] DELETE /identity/v3/users/fe0862d2f6694be5b4ef0d760a55d10d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:37:28.885268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6911c-e8f9-476f-a7ac-78d438f7c398 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:28.899638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6911c-e8f9-476f-a7ac-78d438f7c398 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:28.957843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:28.958464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:28.958736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:28.958999 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] PATH_INFO: `/v3/projects/c9ab4e450b95482bab2d02d051949fc3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:28.960164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ab4e450b95482bab2d02d051949fc3)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:28.962077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:29.013729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ab4e450b95482bab2d02d051949fc3', 'request_id': 'req-6129cda0-5409-4056-8cf2-7bc13ef56eb3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:29.022603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ab4e450b95482bab2d02d051949fc3', 'request_id': 'req-6129cda0-5409-4056-8cf2-7bc13ef56eb3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:29.028287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ab4e450b95482bab2d02d051949fc3', 'request_id': 'req-6129cda0-5409-4056-8cf2-7bc13ef56eb3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:29.039239 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] The token cache is being invalidate because project c9ab4e450b95482bab2d02d051949fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:37:29.039544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:29.040165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6129cda0-5409-4056-8cf2-7bc13ef56eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:29.041637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1204/2432] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:37:28 2022] DELETE /identity/v3/projects/c9ab4e450b95482bab2d02d051949fc3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:37:29.046609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d9923-f378-4b03-80e4-865cd386b677 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:29.046895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d9923-f378-4b03-80e4-865cd386b677 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:29.047166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d9923-f378-4b03-80e4-865cd386b677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:29.067718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2d6d9923-f378-4b03-80e4-865cd386b677 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:37:29.068959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2d6d9923-f378-4b03-80e4-865cd386b677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:29.131702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1229/2433] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:37:29.139590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4b086-f9cc-484e-b861-5703bde47756 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:29.139872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4b086-f9cc-484e-b861-5703bde47756 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:29.140138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4b086-f9cc-484e-b861-5703bde47756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:29.170893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d7c4b086-f9cc-484e-b861-5703bde47756 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:37:29.172312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d7c4b086-f9cc-484e-b861-5703bde47756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:29.182156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1205/2434] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:37:29.186600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d9923-f378-4b03-80e4-865cd386b677 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:29.197461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d9923-f378-4b03-80e4-865cd386b677 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:29.202524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729a659-07b1-4a6a-aa6c-b970dce27f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:29.205996 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a659-07b1-4a6a-aa6c-b970dce27f09 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:29.206301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a659-07b1-4a6a-aa6c-b970dce27f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:29.206551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a659-07b1-4a6a-aa6c-b970dce27f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:29.207228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729a659-07b1-4a6a-aa6c-b970dce27f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:37:29.207554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729a659-07b1-4a6a-aa6c-b970dce27f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:29.209220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729a659-07b1-4a6a-aa6c-b970dce27f09 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:29.228988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1230/2435] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:37:29.233309 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4b086-f9cc-484e-b861-5703bde47756 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:29.243581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4b086-f9cc-484e-b861-5703bde47756 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:29.248881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ea6da-7ae0-4640-aa11-7e68b2f49c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:29.250221 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ea6da-7ae0-4640-aa11-7e68b2f49c3e admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:29.250496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ea6da-7ae0-4640-aa11-7e68b2f49c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:29.250763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ea6da-7ae0-4640-aa11-7e68b2f49c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:29.251455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ea6da-7ae0-4640-aa11-7e68b2f49c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:29.253430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ea6da-7ae0-4640-aa11-7e68b2f49c3e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:29.284114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1206/2436] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:37:29 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:37:29.288603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729a659-07b1-4a6a-aa6c-b970dce27f09 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:29.299021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729a659-07b1-4a6a-aa6c-b970dce27f09 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:29.361112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565bc5-ec92-4f22-adfd-7e33e76c667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:29.361721 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565bc5-ec92-4f22-adfd-7e33e76c667d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:29.362356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565bc5-ec92-4f22-adfd-7e33e76c667d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:29.362618 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565bc5-ec92-4f22-adfd-7e33e76c667d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:29.363294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45565bc5-ec92-4f22-adfd-7e33e76c667d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:29.365262 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45565bc5-ec92-4f22-adfd-7e33e76c667d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:29.373499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:29.392874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1231/2437] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:37:29 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:37:29.394286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ea6da-7ae0-4640-aa11-7e68b2f49c3e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:29.405213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ea6da-7ae0-4640-aa11-7e68b2f49c3e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:29.410270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50e4b9-18fe-462c-a9cc-dcc7aab83219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:29.411047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50e4b9-18fe-462c-a9cc-dcc7aab83219 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:29.411348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50e4b9-18fe-462c-a9cc-dcc7aab83219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:29.411631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50e4b9-18fe-462c-a9cc-dcc7aab83219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:29.412290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50e4b9-18fe-462c-a9cc-dcc7aab83219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:29.413881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50e4b9-18fe-462c-a9cc-dcc7aab83219 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:29.415374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:29.429188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1207/2438] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:37:29.430657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565bc5-ec92-4f22-adfd-7e33e76c667d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:29.440874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565bc5-ec92-4f22-adfd-7e33e76c667d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:29.446054 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21239f-1b52-49b0-8ba4-4c4367e39d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:29.446746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21239f-1b52-49b0-8ba4-4c4367e39d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:29.447018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21239f-1b52-49b0-8ba4-4c4367e39d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:29.447282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21239f-1b52-49b0-8ba4-4c4367e39d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:29.447985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21239f-1b52-49b0-8ba4-4c4367e39d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:29.449575 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21239f-1b52-49b0-8ba4-4c4367e39d14 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:29.460541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1232/2439] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:37:29.464711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50e4b9-18fe-462c-a9cc-dcc7aab83219 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:29.474936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50e4b9-18fe-462c-a9cc-dcc7aab83219 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:29.479649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785c796-8361-417c-9220-cc706474e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:29.480298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785c796-8361-417c-9220-cc706474e021 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:29.480565 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785c796-8361-417c-9220-cc706474e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:29.480828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785c796-8361-417c-9220-cc706474e021 admin admin] PATH_INFO: `/v3/projects/41773d7955c948fcb0b9607597b57d77/users/3e205d5d77694172a46610cc03741f4f/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:29.496801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785c796-8361-417c-9220-cc706474e021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41773d7955c948fcb0b9607597b57d77, user_id=3e205d5d77694172a46610cc03741f4f, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:29.499719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785c796-8361-417c-9220-cc706474e021 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:29.514302 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1208/2440] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:37:29 2022] PUT /identity/v3/projects/41773d7955c948fcb0b9607597b57d77/users/3e205d5d77694172a46610cc03741f4f/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:37:29.524498 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0127623-283d-440b-90b1-a13ee77e9d24 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:29.524778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0127623-283d-440b-90b1-a13ee77e9d24 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:29.525044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0127623-283d-440b-90b1-a13ee77e9d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:29.553045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c0127623-283d-440b-90b1-a13ee77e9d24 None None] MFA Rules not processed for user `3e205d5d77694172a46610cc03741f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:37:29.554273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c0127623-283d-440b-90b1-a13ee77e9d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:29.624599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1233/2441] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:37:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:37:29.635777 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785c796-8361-417c-9220-cc706474e021 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:29.639776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b785c796-8361-417c-9220-cc706474e021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:29.697079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785c796-8361-417c-9220-cc706474e021 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:29.701023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef3c1d-7630-416f-90cf-0d2506d27c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:29.701623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef3c1d-7630-416f-90cf-0d2506d27c06 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:29.701895 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef3c1d-7630-416f-90cf-0d2506d27c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:29.702157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef3c1d-7630-416f-90cf-0d2506d27c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:29.713690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef3c1d-7630-416f-90cf-0d2506d27c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:29.716023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef3c1d-7630-416f-90cf-0d2506d27c06 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:29.730863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1209/2442] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:37:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:37:30.391972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0127623-283d-440b-90b1-a13ee77e9d24 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:30.393507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c0127623-283d-440b-90b1-a13ee77e9d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:30.454815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0127623-283d-440b-90b1-a13ee77e9d24 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:30.458811 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1383e-e72c-45c7-b481-2261e244819c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:30.459454 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1383e-e72c-45c7-b481-2261e244819c service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:30.459729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1383e-e72c-45c7-b481-2261e244819c service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:30.459993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1383e-e72c-45c7-b481-2261e244819c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:30.461770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-49b1383e-e72c-45c7-b481-2261e244819c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:30.536911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1383e-e72c-45c7-b481-2261e244819c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:30.538275 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1383e-e72c-45c7-b481-2261e244819c service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:30.550624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1234/2443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:37:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:37:31.731572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef3c1d-7630-416f-90cf-0d2506d27c06 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:31.742380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef3c1d-7630-416f-90cf-0d2506d27c06 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:31.746258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62398967-af7a-4bde-a45f-3e38540cb08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:31.746851 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398967-af7a-4bde-a45f-3e38540cb08b service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:31.747121 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398967-af7a-4bde-a45f-3e38540cb08b service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:31.747422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398967-af7a-4bde-a45f-3e38540cb08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:31.749158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-62398967-af7a-4bde-a45f-3e38540cb08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:31.762303 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62398967-af7a-4bde-a45f-3e38540cb08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:31.763762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62398967-af7a-4bde-a45f-3e38540cb08b service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:31.774595 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1210/2444] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:37:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:37:39.987255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1383e-e72c-45c7-b481-2261e244819c service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:39.997304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:40.052948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1383e-e72c-45c7-b481-2261e244819c service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:40.057940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:40.058579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:40.058894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:40.059162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] PATH_INFO: `/v3/users/3e205d5d77694172a46610cc03741f4f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:40.060328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e205d5d77694172a46610cc03741f4f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:40.062299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:40.112315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e205d5d77694172a46610cc03741f4f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:40.121198 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e205d5d77694172a46610cc03741f4f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:40.133646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e205d5d77694172a46610cc03741f4f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:40.134439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e205d5d77694172a46610cc03741f4f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:40.142199 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e205d5d77694172a46610cc03741f4f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:40.148322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1235/2445] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:37:39 2022] DELETE /identity/v3/users/3e205d5d77694172a46610cc03741f4f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:37:40.153069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea69113-27e1-4641-8069-1c58a7a24854 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:40.153586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea69113-27e1-4641-8069-1c58a7a24854 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:40.153763 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea69113-27e1-4641-8069-1c58a7a24854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:40.173879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-bea69113-27e1-4641-8069-1c58a7a24854 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:37:40.175080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bea69113-27e1-4641-8069-1c58a7a24854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:40.236270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1211/2446] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:37:40.246924 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:40.248420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:40.308620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6b511-326c-491b-9e03-35dd9a226536 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:40.313546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c60fc-e968-4269-91d1-6acca11e4569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:40.314168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c60fc-e968-4269-91d1-6acca11e4569 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:40.314434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c60fc-e968-4269-91d1-6acca11e4569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:40.314720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c60fc-e968-4269-91d1-6acca11e4569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:40.325403 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c60fc-e968-4269-91d1-6acca11e4569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:40.326833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c60fc-e968-4269-91d1-6acca11e4569 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:40.339410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1236/2447] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:37:40.727822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea69113-27e1-4641-8069-1c58a7a24854 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:40.729385 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bea69113-27e1-4641-8069-1c58a7a24854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:40.744026 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea69113-27e1-4641-8069-1c58a7a24854 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:40.762852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:40.763788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:40.763939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:40.764208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] PATH_INFO: `/v3/projects/41773d7955c948fcb0b9607597b57d77` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:40.765453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41773d7955c948fcb0b9607597b57d77)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:40.777805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:40.887625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41773d7955c948fcb0b9607597b57d77', 'request_id': 'req-44da030d-f744-49ed-9ac0-e53d06aca519'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:40.902943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41773d7955c948fcb0b9607597b57d77', 'request_id': 'req-44da030d-f744-49ed-9ac0-e53d06aca519'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:40.904757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:40.919038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41773d7955c948fcb0b9607597b57d77', 'request_id': 'req-44da030d-f744-49ed-9ac0-e53d06aca519'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:40.951394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] The token cache is being invalidate because project 41773d7955c948fcb0b9607597b57d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:37:40.952507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:40.952634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:37:40.954258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1212/2448] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:37:40 2022] DELETE /identity/v3/projects/41773d7955c948fcb0b9607597b57d77 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:37:46.428682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c60fc-e968-4269-91d1-6acca11e4569 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:46.431292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-654c60fc-e968-4269-91d1-6acca11e4569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:46.448945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c60fc-e968-4269-91d1-6acca11e4569 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:46.484012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:46.509028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e1e6a-2fa4-487d-a184-17d34bfe5bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:46.509633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e1e6a-2fa4-487d-a184-17d34bfe5bfe service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:46.509903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e1e6a-2fa4-487d-a184-17d34bfe5bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:46.510165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e1e6a-2fa4-487d-a184-17d34bfe5bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:46.512116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fe0e1e6a-2fa4-487d-a184-17d34bfe5bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:46.570989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e1e6a-2fa4-487d-a184-17d34bfe5bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:46.572452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e1e6a-2fa4-487d-a184-17d34bfe5bfe service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:46.579625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:46.581197 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:46.582213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1237/2449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:37:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:37:46.655166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da030d-f744-49ed-9ac0-e53d06aca519 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:46.660751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09597e66-dcb3-4058-8181-d1a040f7e8e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:46.661355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09597e66-dcb3-4058-8181-d1a040f7e8e1 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:46.661750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09597e66-dcb3-4058-8181-d1a040f7e8e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:46.661929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09597e66-dcb3-4058-8181-d1a040f7e8e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:46.671227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09597e66-dcb3-4058-8181-d1a040f7e8e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:46.672859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09597e66-dcb3-4058-8181-d1a040f7e8e1 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:46.682405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1213/2450] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:37:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:37:51.188886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2b9b7-cbe3-4934-9e24-ffd46ca1bb31 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:51.189432 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2b9b7-cbe3-4934-9e24-ffd46ca1bb31 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:51.189536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2b9b7-cbe3-4934-9e24-ffd46ca1bb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:51.210137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-88d2b9b7-cbe3-4934-9e24-ffd46ca1bb31 None None] MFA Rules not processed for user `deea84058f724ff3b78caa9d8b010202`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:37:51.211354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-88d2b9b7-cbe3-4934-9e24-ffd46ca1bb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:51.222100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1238/2451] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:37:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:37:51.551600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09597e66-dcb3-4058-8181-d1a040f7e8e1 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:51.553108 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-09597e66-dcb3-4058-8181-d1a040f7e8e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:51.565120 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09597e66-dcb3-4058-8181-d1a040f7e8e1 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:51.568903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954019f-6b5c-4025-a675-aa58f392f58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:51.569500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954019f-6b5c-4025-a675-aa58f392f58d service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:51.569772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954019f-6b5c-4025-a675-aa58f392f58d service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:51.570042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954019f-6b5c-4025-a675-aa58f392f58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:51.571781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9954019f-6b5c-4025-a675-aa58f392f58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:51.582068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954019f-6b5c-4025-a675-aa58f392f58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:51.583536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954019f-6b5c-4025-a675-aa58f392f58d service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:51.592194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1214/2452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:37:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:37:51.927027 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2b9b7-cbe3-4934-9e24-ffd46ca1bb31 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:51.928770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-88d2b9b7-cbe3-4934-9e24-ffd46ca1bb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:52.003104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2b9b7-cbe3-4934-9e24-ffd46ca1bb31 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:52.009201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87d03-d666-48a7-ad1a-4015b09ec916 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:52.009814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87d03-d666-48a7-ad1a-4015b09ec916 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:52.010092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87d03-d666-48a7-ad1a-4015b09ec916 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:52.010361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87d03-d666-48a7-ad1a-4015b09ec916 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:52.012192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0fb87d03-d666-48a7-ad1a-4015b09ec916 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:52.023972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb87d03-d666-48a7-ad1a-4015b09ec916 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:52.025551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb87d03-d666-48a7-ad1a-4015b09ec916 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:52.035329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1239/2453] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:37:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:37:54.335622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954019f-6b5c-4025-a675-aa58f392f58d service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:37:54.337342 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9954019f-6b5c-4025-a675-aa58f392f58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:54.348068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954019f-6b5c-4025-a675-aa58f392f58d service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:37:54.352249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56a148-cbe6-4d0c-9fa6-9385298c320f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:37:54.352872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56a148-cbe6-4d0c-9fa6-9385298c320f service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:37:54.353320 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56a148-cbe6-4d0c-9fa6-9385298c320f service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:37:54.353591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56a148-cbe6-4d0c-9fa6-9385298c320f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:37:54.355478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4d56a148-cbe6-4d0c-9fa6-9385298c320f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:37:54.366973 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56a148-cbe6-4d0c-9fa6-9385298c320f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:37:54.368497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56a148-cbe6-4d0c-9fa6-9385298c320f service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:37:54.379299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1215/2454] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:37:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:02.031482 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=69 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:04.373701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=2,keystone:SELECT=51 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:04.857037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87d03-d666-48a7-ad1a-4015b09ec916 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:04.870395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87d03-d666-48a7-ad1a-4015b09ec916 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:04.876406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44e2a6-573d-465e-87b2-ca31480e00d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:04.877020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44e2a6-573d-465e-87b2-ca31480e00d6 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:04.877294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44e2a6-573d-465e-87b2-ca31480e00d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:04.877566 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44e2a6-573d-465e-87b2-ca31480e00d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:04.879415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bb44e2a6-573d-465e-87b2-ca31480e00d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:04.891665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44e2a6-573d-465e-87b2-ca31480e00d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:04.893246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44e2a6-573d-465e-87b2-ca31480e00d6 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:04.903770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1240/2455] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:14.899147 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:24.239723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56a148-cbe6-4d0c-9fa6-9385298c320f service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:24.241720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4d56a148-cbe6-4d0c-9fa6-9385298c320f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:24.303498 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56a148-cbe6-4d0c-9fa6-9385298c320f service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:24.307849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ac6b0-d037-4997-bcc1-a07ea2c8b976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:24.308452 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ac6b0-d037-4997-bcc1-a07ea2c8b976 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:24.308726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ac6b0-d037-4997-bcc1-a07ea2c8b976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:24.308988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ac6b0-d037-4997-bcc1-a07ea2c8b976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:24.310920 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9a0ac6b0-d037-4997-bcc1-a07ea2c8b976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:24.376319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ac6b0-d037-4997-bcc1-a07ea2c8b976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:24.377754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ac6b0-d037-4997-bcc1-a07ea2c8b976 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:24.387018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1216/2456] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:32.314916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44e2a6-573d-465e-87b2-ca31480e00d6 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:32.316392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bb44e2a6-573d-465e-87b2-ca31480e00d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:32.330470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44e2a6-573d-465e-87b2-ca31480e00d6 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:32.336524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f3cbf-71ea-47f3-bd77-107df5109bed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:32.337123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f3cbf-71ea-47f3-bd77-107df5109bed service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:32.337423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f3cbf-71ea-47f3-bd77-107df5109bed service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:32.337669 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f3cbf-71ea-47f3-bd77-107df5109bed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:32.339654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-035f3cbf-71ea-47f3-bd77-107df5109bed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:32.353203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f3cbf-71ea-47f3-bd77-107df5109bed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:32.355266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f3cbf-71ea-47f3-bd77-107df5109bed service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:32.371495 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1241/2457] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:34.382795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=48 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:42.362526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:45.526785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ac6b0-d037-4997-bcc1-a07ea2c8b976 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:45.529554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9a0ac6b0-d037-4997-bcc1-a07ea2c8b976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:45.544415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ac6b0-d037-4997-bcc1-a07ea2c8b976 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:45.549038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c26686-b122-4e76-b7af-9b45a66019f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:45.549644 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26686-b122-4e76-b7af-9b45a66019f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:45.549911 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26686-b122-4e76-b7af-9b45a66019f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:45.550173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26686-b122-4e76-b7af-9b45a66019f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:45.552307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d7c26686-b122-4e76-b7af-9b45a66019f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:45.596114 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f3cbf-71ea-47f3-bd77-107df5109bed service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:45.607241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f3cbf-71ea-47f3-bd77-107df5109bed service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:45.611015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc5b9f-6796-4e7f-b645-49e8ee07bc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:45.612069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc5b9f-6796-4e7f-b645-49e8ee07bc00 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:45.612437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc5b9f-6796-4e7f-b645-49e8ee07bc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:45.612702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc5b9f-6796-4e7f-b645-49e8ee07bc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:45.614606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-28cc5b9f-6796-4e7f-b645-49e8ee07bc00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:45.621703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c26686-b122-4e76-b7af-9b45a66019f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:45.623150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c26686-b122-4e76-b7af-9b45a66019f4 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:45.635062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1217/2458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:45.697290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc5b9f-6796-4e7f-b645-49e8ee07bc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:45.698725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc5b9f-6796-4e7f-b645-49e8ee07bc00 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:45.710284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1242/2459] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:49.914726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c26686-b122-4e76-b7af-9b45a66019f4 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:49.916864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d7c26686-b122-4e76-b7af-9b45a66019f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:49.937402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c26686-b122-4e76-b7af-9b45a66019f4 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:49.943511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:49.944240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:49.944710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:49.945147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] PATH_INFO: `/v3/users/3b8b820bb8ad4599837afad008daf413` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:49.947785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8b820bb8ad4599837afad008daf413)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:49.950174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:50.032613 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8b820bb8ad4599837afad008daf413'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:38:50.033245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8b820bb8ad4599837afad008daf413'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:38:50.042749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8b820bb8ad4599837afad008daf413'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:38:50.058045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8b820bb8ad4599837afad008daf413'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:38:50.065296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8b820bb8ad4599837afad008daf413'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:38:50.075449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1218/2460] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:38:49 2022] DELETE /identity/v3/users/3b8b820bb8ad4599837afad008daf413 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:38:50.229927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc5b9f-6796-4e7f-b645-49e8ee07bc00 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:50.239853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc5b9f-6796-4e7f-b645-49e8ee07bc00 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:50.249437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:50.250901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:50.299154 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199d6b0-98fb-4d3d-a9dd-1fc8deb7f85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:50.299799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199d6b0-98fb-4d3d-a9dd-1fc8deb7f85f service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.300069 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199d6b0-98fb-4d3d-a9dd-1fc8deb7f85f service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.300409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199d6b0-98fb-4d3d-a9dd-1fc8deb7f85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.302195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0199d6b0-98fb-4d3d-a9dd-1fc8deb7f85f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:50.312119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199d6b0-98fb-4d3d-a9dd-1fc8deb7f85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:50.313969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199d6b0-98fb-4d3d-a9dd-1fc8deb7f85f service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:50.329932 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1243/2461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:50.336494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b142c-3c48-44b7-9a95-be2287b681db admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:50.341179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:50.341818 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.342111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.342381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] PATH_INFO: `/v3/projects/e4fef755a3b34cb68b757b8bbaa00bed` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.343521 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4fef755a3b34cb68b757b8bbaa00bed)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:50.345468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:50.359542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:50.405723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4fef755a3b34cb68b757b8bbaa00bed', 'request_id': 'req-3db7e5b5-5c05-4534-9861-d6b50ca64d76'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:38:50.415408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4fef755a3b34cb68b757b8bbaa00bed', 'request_id': 'req-3db7e5b5-5c05-4534-9861-d6b50ca64d76'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:38:50.422000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4fef755a3b34cb68b757b8bbaa00bed', 'request_id': 'req-3db7e5b5-5c05-4534-9861-d6b50ca64d76'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:38:50.435758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] The token cache is being invalidate because project e4fef755a3b34cb68b757b8bbaa00bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:38:50.436059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:38:50.436722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3db7e5b5-5c05-4534-9861-d6b50ca64d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:38:50.438218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1219/2462] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:38:50 2022] DELETE /identity/v3/projects/e4fef755a3b34cb68b757b8bbaa00bed => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:38:50.443568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3454488-2b1d-4382-a03f-bc10c8efbb43 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.443858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3454488-2b1d-4382-a03f-bc10c8efbb43 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.444220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3454488-2b1d-4382-a03f-bc10c8efbb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.468122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a3454488-2b1d-4382-a03f-bc10c8efbb43 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:38:50.469852 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a3454488-2b1d-4382-a03f-bc10c8efbb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:50.532782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1244/2463] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:38:50.541025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eabaf-b71d-4599-a511-6f83e01d0204 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.541306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eabaf-b71d-4599-a511-6f83e01d0204 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.541573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eabaf-b71d-4599-a511-6f83e01d0204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.561925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8a0eabaf-b71d-4599-a511-6f83e01d0204 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:38:50.563054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8a0eabaf-b71d-4599-a511-6f83e01d0204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:50.571443 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1220/2464] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:38:50.575836 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3454488-2b1d-4382-a03f-bc10c8efbb43 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:50.585854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3454488-2b1d-4382-a03f-bc10c8efbb43 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:50.591343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85571eea-31c4-45e1-878b-7ef7d3056647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:50.591967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571eea-31c4-45e1-878b-7ef7d3056647 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.592236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571eea-31c4-45e1-878b-7ef7d3056647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.592510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571eea-31c4-45e1-878b-7ef7d3056647 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.593160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85571eea-31c4-45e1-878b-7ef7d3056647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:38:50.593462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85571eea-31c4-45e1-878b-7ef7d3056647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:50.595090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85571eea-31c4-45e1-878b-7ef7d3056647 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:50.607280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1245/2465] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:38:50.611947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eabaf-b71d-4599-a511-6f83e01d0204 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:50.621786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eabaf-b71d-4599-a511-6f83e01d0204 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:50.627098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8120-fdf4-456c-ae20-2e9d81b68e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:50.627801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8120-fdf4-456c-ae20-2e9d81b68e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.628141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8120-fdf4-456c-ae20-2e9d81b68e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.628416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8120-fdf4-456c-ae20-2e9d81b68e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.629053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8120-fdf4-456c-ae20-2e9d81b68e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:50.631074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8120-fdf4-456c-ae20-2e9d81b68e18 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:50.663069 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1221/2466] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:38:50 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:38:50.667445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85571eea-31c4-45e1-878b-7ef7d3056647 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:50.678014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85571eea-31c4-45e1-878b-7ef7d3056647 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:50.701457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:50.742232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab9305-6a83-48b0-9f63-59245730b1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:50.742844 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab9305-6a83-48b0-9f63-59245730b1dd admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.743121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab9305-6a83-48b0-9f63-59245730b1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.743415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab9305-6a83-48b0-9f63-59245730b1dd admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.744040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab9305-6a83-48b0-9f63-59245730b1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:50.745965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab9305-6a83-48b0-9f63-59245730b1dd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:50.768167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1246/2467] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:38:50 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:38:50.772518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8120-fdf4-456c-ae20-2e9d81b68e18 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:50.782554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8120-fdf4-456c-ae20-2e9d81b68e18 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:50.787393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4a01-812a-40d9-a02b-1b33c6eb0669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:50.787920 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4a01-812a-40d9-a02b-1b33c6eb0669 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.788193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4a01-812a-40d9-a02b-1b33c6eb0669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.788457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4a01-812a-40d9-a02b-1b33c6eb0669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.789090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc4a01-812a-40d9-a02b-1b33c6eb0669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:50.790668 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc4a01-812a-40d9-a02b-1b33c6eb0669 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:50.800793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1222/2468] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:38:50.804896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab9305-6a83-48b0-9f63-59245730b1dd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:50.815757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab9305-6a83-48b0-9f63-59245730b1dd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:50.821559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d6d33-d6a5-4656-9c9f-e591994d6802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:50.822164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d6d33-d6a5-4656-9c9f-e591994d6802 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.822447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d6d33-d6a5-4656-9c9f-e591994d6802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.822714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d6d33-d6a5-4656-9c9f-e591994d6802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.823338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d6d33-d6a5-4656-9c9f-e591994d6802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:50.824955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d6d33-d6a5-4656-9c9f-e591994d6802 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:50.836046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1247/2469] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:38:50.840869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4a01-812a-40d9-a02b-1b33c6eb0669 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:50.855967 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4a01-812a-40d9-a02b-1b33c6eb0669 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:50.864380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be2f9e-721c-4c89-9777-baaea94fd566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:50.865026 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2f9e-721c-4c89-9777-baaea94fd566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.865327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2f9e-721c-4c89-9777-baaea94fd566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.865562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2f9e-721c-4c89-9777-baaea94fd566 admin admin] PATH_INFO: `/v3/projects/34977660f3f9474a8f5b075b369ece33/users/d472fb0bb1c84ff18f03bf2bd510cc6f/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.880475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be2f9e-721c-4c89-9777-baaea94fd566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34977660f3f9474a8f5b075b369ece33, user_id=d472fb0bb1c84ff18f03bf2bd510cc6f, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:50.883083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be2f9e-721c-4c89-9777-baaea94fd566 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:50.898093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1223/2470] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:38:50 2022] PUT /identity/v3/projects/34977660f3f9474a8f5b075b369ece33/users/d472fb0bb1c84ff18f03bf2bd510cc6f/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:38:50.903268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3faef-6294-4e14-8921-f11118aec26d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:50.903582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3faef-6294-4e14-8921-f11118aec26d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:50.903853 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3faef-6294-4e14-8921-f11118aec26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:50.922867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b0f3faef-6294-4e14-8921-f11118aec26d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:38:50.924092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b0f3faef-6294-4e14-8921-f11118aec26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:50.984160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1248/2471] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:38:50.995032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be2f9e-721c-4c89-9777-baaea94fd566 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:50.996940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-07be2f9e-721c-4c89-9777-baaea94fd566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:51.059803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be2f9e-721c-4c89-9777-baaea94fd566 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:51.064054 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0a0a8-3165-4833-bccd-4e3e0c809d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:51.064726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a0a8-3165-4833-bccd-4e3e0c809d1c service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:51.064964 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a0a8-3165-4833-bccd-4e3e0c809d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:51.065232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a0a8-3165-4833-bccd-4e3e0c809d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:51.076584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0a0a8-3165-4833-bccd-4e3e0c809d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:51.077912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0a0a8-3165-4833-bccd-4e3e0c809d1c service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:51.088057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1224/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:51.508952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641478d-d8fe-4293-8e5c-f15caef8cf01 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:51.509538 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641478d-d8fe-4293-8e5c-f15caef8cf01 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:51.509837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641478d-d8fe-4293-8e5c-f15caef8cf01 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:51.511611 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1249/2473] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:38:51.517284 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39e8f-83fb-49e0-9171-354244f4f357 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:51.517664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39e8f-83fb-49e0-9171-354244f4f357 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:51.518048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39e8f-83fb-49e0-9171-354244f4f357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:51.542458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e6f39e8f-83fb-49e0-9171-354244f4f357 None None] MFA Rules not processed for user `39ca0a824c4740dbb911bb1a38cfc47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:38:51.544032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e6f39e8f-83fb-49e0-9171-354244f4f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:51.564591 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1225/2474] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:38:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:38:51.582257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641478d-d8fe-4293-8e5c-f15caef8cf01 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:51.584723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a641478d-d8fe-4293-8e5c-f15caef8cf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:51.602066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641478d-d8fe-4293-8e5c-f15caef8cf01 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:51.608335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141ef3a-4a23-4f85-9b5d-034e0a9bac94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:51.612599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ef3a-4a23-4f85-9b5d-034e0a9bac94 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:51.613255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ef3a-4a23-4f85-9b5d-034e0a9bac94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:51.613751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ef3a-4a23-4f85-9b5d-034e0a9bac94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:51.627469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141ef3a-4a23-4f85-9b5d-034e0a9bac94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:51.631501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141ef3a-4a23-4f85-9b5d-034e0a9bac94 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:51.648168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1250/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:38:52.863137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913dbf8-49c5-43ec-b86a-95e72133f079 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:52.864308 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913dbf8-49c5-43ec-b86a-95e72133f079 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:52.864770 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913dbf8-49c5-43ec-b86a-95e72133f079 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:52.866481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1226/2476] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:38:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:38:52.877292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805de7-130a-4c3a-abfe-536e12465dfc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:52.878254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805de7-130a-4c3a-abfe-536e12465dfc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:52.878767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805de7-130a-4c3a-abfe-536e12465dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:52.908398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b0805de7-130a-4c3a-abfe-536e12465dfc None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:38:52.909781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b0805de7-130a-4c3a-abfe-536e12465dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:53.026276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1251/2477] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:38:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:38:53.049722 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913dbf8-49c5-43ec-b86a-95e72133f079 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:53.061986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913dbf8-49c5-43ec-b86a-95e72133f079 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:53.066933 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bcc70-ac5e-4e9d-99b9-2d31186792fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:53.067912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bcc70-ac5e-4e9d-99b9-2d31186792fe service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:53.068298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bcc70-ac5e-4e9d-99b9-2d31186792fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:53.068651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bcc70-ac5e-4e9d-99b9-2d31186792fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:53.081960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bcc70-ac5e-4e9d-99b9-2d31186792fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:53.084447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bcc70-ac5e-4e9d-99b9-2d31186792fe service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:53.097229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1227/2478] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:53.661918 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0805de7-130a-4c3a-abfe-536e12465dfc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:53.665186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b0805de7-130a-4c3a-abfe-536e12465dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:53.698716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0805de7-130a-4c3a-abfe-536e12465dfc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:53.706436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34fe80-1896-4e9a-83c8-0168fefff34b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:53.708053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34fe80-1896-4e9a-83c8-0168fefff34b service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:53.708478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34fe80-1896-4e9a-83c8-0168fefff34b service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:53.708752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34fe80-1896-4e9a-83c8-0168fefff34b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:53.711428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ec34fe80-1896-4e9a-83c8-0168fefff34b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:53.726175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34fe80-1896-4e9a-83c8-0168fefff34b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:53.728402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34fe80-1896-4e9a-83c8-0168fefff34b service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:53.759794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1252/2479] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:53.919109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746fe1e-c72a-4726-9d6f-4b34a3d90360 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:53.919617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746fe1e-c72a-4726-9d6f-4b34a3d90360 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:53.919790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746fe1e-c72a-4726-9d6f-4b34a3d90360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:53.947136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0746fe1e-c72a-4726-9d6f-4b34a3d90360 None None] MFA Rules not processed for user `0a64dd6dfd6c478eaabb44f2d1614472`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:38:53.950362 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0746fe1e-c72a-4726-9d6f-4b34a3d90360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:53.974145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:54.023425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1228/2480] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:38:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:38:56.681952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b70677-5018-4395-a9fb-f65b70385e05 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:56.682447 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b70677-5018-4395-a9fb-f65b70385e05 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:56.682544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b70677-5018-4395-a9fb-f65b70385e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:56.704415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:56.715938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c5b70677-5018-4395-a9fb-f65b70385e05 None None] MFA Rules not processed for user `d472fb0bb1c84ff18f03bf2bd510cc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:38:56.717169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c5b70677-5018-4395-a9fb-f65b70385e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:56.787160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1253/2481] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:38:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:38:56.801690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746fe1e-c72a-4726-9d6f-4b34a3d90360 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:38:56.804221 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0746fe1e-c72a-4726-9d6f-4b34a3d90360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:56.826110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746fe1e-c72a-4726-9d6f-4b34a3d90360 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:38:56.833858 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8c0de-fd9c-49ec-b24f-85d5124220a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:38:56.834529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8c0de-fd9c-49ec-b24f-85d5124220a2 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:56.834979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8c0de-fd9c-49ec-b24f-85d5124220a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:56.835232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8c0de-fd9c-49ec-b24f-85d5124220a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:56.843883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8c0de-fd9c-49ec-b24f-85d5124220a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:38:56.846391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8c0de-fd9c-49ec-b24f-85d5124220a2 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:38:56.857157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1229/2482] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:38:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:38:58.554660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e775cf-d734-44d9-9e32-34427c8f8882 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:38:58.555500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e775cf-d734-44d9-9e32-34427c8f8882 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:38:58.555938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e775cf-d734-44d9-9e32-34427c8f8882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:38:58.582120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b9e775cf-d734-44d9-9e32-34427c8f8882 None None] MFA Rules not processed for user `d472fb0bb1c84ff18f03bf2bd510cc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:38:58.585075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b9e775cf-d734-44d9-9e32-34427c8f8882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:38:58.597528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1254/2483] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:38:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:39:06.852904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=22 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:08.576474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=31 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:33.562611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50444c-7291-4653-8359-b6eea9f45ab0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:39:33.563128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50444c-7291-4653-8359-b6eea9f45ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:39:33.563128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50444c-7291-4653-8359-b6eea9f45ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:39:33.583295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7d50444c-7291-4653-8359-b6eea9f45ab0 None None] MFA Rules not processed for user `deea84058f724ff3b78caa9d8b010202`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:39:33.584551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7d50444c-7291-4653-8359-b6eea9f45ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:39:33.651145 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1230/2484] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:39:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:39:43.640655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=25 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:58.458271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e775cf-d734-44d9-9e32-34427c8f8882 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:40:58.508168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e775cf-d734-44d9-9e32-34427c8f8882 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:40:58.512893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6901479-a8f9-46bd-83df-135e7facc476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:40:58.513387 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901479-a8f9-46bd-83df-135e7facc476 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:40:58.514468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901479-a8f9-46bd-83df-135e7facc476 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:40:58.514468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901479-a8f9-46bd-83df-135e7facc476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:40:58.517302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c6901479-a8f9-46bd-83df-135e7facc476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:40:58.618679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6901479-a8f9-46bd-83df-135e7facc476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:40:58.620161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6901479-a8f9-46bd-83df-135e7facc476 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:40:58.630354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1255/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:40:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:00.323803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50444c-7291-4653-8359-b6eea9f45ab0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:00.326953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7d50444c-7291-4653-8359-b6eea9f45ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:00.558846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50444c-7291-4653-8359-b6eea9f45ab0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:00.565090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753b30-c3e0-472f-8d7b-7a771de9c130 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:00.565819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753b30-c3e0-472f-8d7b-7a771de9c130 service placement] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:00.566227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753b30-c3e0-472f-8d7b-7a771de9c130 service placement] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:00.566586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753b30-c3e0-472f-8d7b-7a771de9c130 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:00.568645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d9753b30-c3e0-472f-8d7b-7a771de9c130 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:00.581527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9753b30-c3e0-472f-8d7b-7a771de9c130 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:00.583341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9753b30-c3e0-472f-8d7b-7a771de9c130 service placement] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:00.593958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1231/2486] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:04.405807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361798-7606-462e-a5e0-8fa54d2f9fac None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:04.406360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361798-7606-462e-a5e0-8fa54d2f9fac None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:04.406479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361798-7606-462e-a5e0-8fa54d2f9fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:04.440770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-83361798-7606-462e-a5e0-8fa54d2f9fac None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:04.441899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-83361798-7606-462e-a5e0-8fa54d2f9fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:04.510665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1256/2487] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:04.568116 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753b30-c3e0-472f-8d7b-7a771de9c130 service placement] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:04.569766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d9753b30-c3e0-472f-8d7b-7a771de9c130 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:04.659471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753b30-c3e0-472f-8d7b-7a771de9c130 service placement] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:04.664377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609484b-a2a3-4d0d-930f-d864ed9e53ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:04.664989 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609484b-a2a3-4d0d-930f-d864ed9e53ea service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:04.665267 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609484b-a2a3-4d0d-930f-d864ed9e53ea service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:04.665535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609484b-a2a3-4d0d-930f-d864ed9e53ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:04.674559 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609484b-a2a3-4d0d-930f-d864ed9e53ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:04.676129 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609484b-a2a3-4d0d-930f-d864ed9e53ea service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:04.684593 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1232/2488] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:41:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:41:06.613908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361798-7606-462e-a5e0-8fa54d2f9fac None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:06.627929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361798-7606-462e-a5e0-8fa54d2f9fac None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:06.634982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0771f-6dd0-46f4-8305-16bb2928f5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:06.636816 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0771f-6dd0-46f4-8305-16bb2928f5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:06.637252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0771f-6dd0-46f4-8305-16bb2928f5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:06.637724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0771f-6dd0-46f4-8305-16bb2928f5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:06.641010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1cd0771f-6dd0-46f4-8305-16bb2928f5e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:06.721214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0771f-6dd0-46f4-8305-16bb2928f5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:06.722977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0771f-6dd0-46f4-8305-16bb2928f5e9 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:06.743667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:06.761393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1257/2489] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:08.188799 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609484b-a2a3-4d0d-930f-d864ed9e53ea service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:08.210810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609484b-a2a3-4d0d-930f-d864ed9e53ea service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:08.220513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c80b4-b2b6-4bdc-8ff8-99ef0ce034d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:08.221257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c80b4-b2b6-4bdc-8ff8-99ef0ce034d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:08.222848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c80b4-b2b6-4bdc-8ff8-99ef0ce034d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:08.223222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c80b4-b2b6-4bdc-8ff8-99ef0ce034d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:08.228201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-476c80b4-b2b6-4bdc-8ff8-99ef0ce034d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:08.262097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c80b4-b2b6-4bdc-8ff8-99ef0ce034d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:08.267047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c80b4-b2b6-4bdc-8ff8-99ef0ce034d7 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:08.295629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1233/2490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:11.552541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0771f-6dd0-46f4-8305-16bb2928f5e9 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:11.554550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1cd0771f-6dd0-46f4-8305-16bb2928f5e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:11.584541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0771f-6dd0-46f4-8305-16bb2928f5e9 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:11.600405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004e421-40bb-450d-89ea-1f2bbba43099 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:11.601044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e421-40bb-450d-89ea-1f2bbba43099 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:11.601321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e421-40bb-450d-89ea-1f2bbba43099 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:11.601591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e421-40bb-450d-89ea-1f2bbba43099 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:11.604834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1004e421-40bb-450d-89ea-1f2bbba43099 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:11.654015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004e421-40bb-450d-89ea-1f2bbba43099 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:11.655342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004e421-40bb-450d-89ea-1f2bbba43099 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:11.697551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1258/2491] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:14.119086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c80b4-b2b6-4bdc-8ff8-99ef0ce034d7 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:14.133368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c80b4-b2b6-4bdc-8ff8-99ef0ce034d7 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:14.140740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e56616-55f0-40d9-aa41-f2cc61ed2b6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:14.141584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e56616-55f0-40d9-aa41-f2cc61ed2b6f service placement] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:14.142064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e56616-55f0-40d9-aa41-f2cc61ed2b6f service placement] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:14.142512 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e56616-55f0-40d9-aa41-f2cc61ed2b6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:14.144466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-22e56616-55f0-40d9-aa41-f2cc61ed2b6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:14.168742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e56616-55f0-40d9-aa41-f2cc61ed2b6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:14.170570 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e56616-55f0-40d9-aa41-f2cc61ed2b6f service placement] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:14.193110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:14.205972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1234/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:14.233563 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004e421-40bb-450d-89ea-1f2bbba43099 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:14.241759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1004e421-40bb-450d-89ea-1f2bbba43099 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:14.300352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004e421-40bb-450d-89ea-1f2bbba43099 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:14.317891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:14.319795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:14.320327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:14.320818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] PATH_INFO: `/v3/users/0a64dd6dfd6c478eaabb44f2d1614472` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:14.322700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a64dd6dfd6c478eaabb44f2d1614472)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:14.325462 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:14.422556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a64dd6dfd6c478eaabb44f2d1614472'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:14.436261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a64dd6dfd6c478eaabb44f2d1614472'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:14.463876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a64dd6dfd6c478eaabb44f2d1614472'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:14.465068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a64dd6dfd6c478eaabb44f2d1614472'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:14.474846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-20d6fed8-9af8-461a-9c58-1cb89dab7aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a64dd6dfd6c478eaabb44f2d1614472'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:14.486862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1259/2493] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:14 2022] DELETE /identity/v3/users/0a64dd6dfd6c478eaabb44f2d1614472 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:14.730873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e56616-55f0-40d9-aa41-f2cc61ed2b6f service placement] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:14.753558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e56616-55f0-40d9-aa41-f2cc61ed2b6f service placement] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:14.905216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:14.906009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:14.906374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:14.906734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] PATH_INFO: `/v3/projects/ea299ab316884af5bdad2ea131658d48` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:14.909674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea299ab316884af5bdad2ea131658d48)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:14.911848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:15.052714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea299ab316884af5bdad2ea131658d48', 'request_id': 'req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:15.105934 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea299ab316884af5bdad2ea131658d48', 'request_id': 'req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:15.120862 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea299ab316884af5bdad2ea131658d48', 'request_id': 'req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:15.158258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] The token cache is being invalidate because project ea299ab316884af5bdad2ea131658d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:15.158549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:15.160370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc0bcbcc-d3cd-4a99-8a9a-ddf8cbf388d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:15.162959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1235/2494] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:14 2022] DELETE /identity/v3/projects/ea299ab316884af5bdad2ea131658d48 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:15.167406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a96398-f8a6-4fb6-b85f-396cc2efc12d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:15.167919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a96398-f8a6-4fb6-b85f-396cc2efc12d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:15.168228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a96398-f8a6-4fb6-b85f-396cc2efc12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:15.327810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-11a96398-f8a6-4fb6-b85f-396cc2efc12d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:15.329058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-11a96398-f8a6-4fb6-b85f-396cc2efc12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:15.444885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1260/2495] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:15.452977 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a1a8b-96da-4fd2-9720-f17b7b481354 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:15.454428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a1a8b-96da-4fd2-9720-f17b7b481354 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:15.454927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a1a8b-96da-4fd2-9720-f17b7b481354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:15.491343 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-197a1a8b-96da-4fd2-9720-f17b7b481354 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:15.493125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-197a1a8b-96da-4fd2-9720-f17b7b481354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:15.518147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1236/2496] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:15.524237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a96398-f8a6-4fb6-b85f-396cc2efc12d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:15.546245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a96398-f8a6-4fb6-b85f-396cc2efc12d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:15.590148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50d844-d196-41be-9f64-cd5042065016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:15.590810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50d844-d196-41be-9f64-cd5042065016 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:15.593776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50d844-d196-41be-9f64-cd5042065016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:15.594249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50d844-d196-41be-9f64-cd5042065016 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:15.595125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50d844-d196-41be-9f64-cd5042065016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:41:15.596404 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50d844-d196-41be-9f64-cd5042065016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:15.599287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50d844-d196-41be-9f64-cd5042065016 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:15.631047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1261/2497] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:41:15.634039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a1a8b-96da-4fd2-9720-f17b7b481354 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:15.646984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a1a8b-96da-4fd2-9720-f17b7b481354 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:15.660251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdcc0e-def0-436a-9b76-22b267e5e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:15.660991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdcc0e-def0-436a-9b76-22b267e5e6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:15.661351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdcc0e-def0-436a-9b76-22b267e5e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:15.661847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdcc0e-def0-436a-9b76-22b267e5e6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:15.662566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdcc0e-def0-436a-9b76-22b267e5e6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:15.664588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdcc0e-def0-436a-9b76-22b267e5e6d2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:15.734678 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1237/2498] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:15 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:15.738966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50d844-d196-41be-9f64-cd5042065016 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:15.753695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50d844-d196-41be-9f64-cd5042065016 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:15.785124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:15.876209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcc3d8-d6f4-4fad-94d9-00e98e72918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:15.880793 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcc3d8-d6f4-4fad-94d9-00e98e72918f admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:15.881674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcc3d8-d6f4-4fad-94d9-00e98e72918f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:15.881967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcc3d8-d6f4-4fad-94d9-00e98e72918f admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:15.882647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcc3d8-d6f4-4fad-94d9-00e98e72918f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:15.885611 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcc3d8-d6f4-4fad-94d9-00e98e72918f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:15.942441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1262/2499] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:15 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:15.946385 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdcc0e-def0-436a-9b76-22b267e5e6d2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:15.962115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdcc0e-def0-436a-9b76-22b267e5e6d2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:15.983355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076ff2b-7673-4ae7-8328-17b44945c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:15.984219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076ff2b-7673-4ae7-8328-17b44945c069 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:15.984576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076ff2b-7673-4ae7-8328-17b44945c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:15.984967 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076ff2b-7673-4ae7-8328-17b44945c069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:15.986063 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076ff2b-7673-4ae7-8328-17b44945c069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:15.987804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076ff2b-7673-4ae7-8328-17b44945c069 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:16.003826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1238/2500] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:16.006528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcc3d8-d6f4-4fad-94d9-00e98e72918f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:16.017808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcc3d8-d6f4-4fad-94d9-00e98e72918f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:16.022795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19024f47-f8b4-407d-a091-ea933e4f4485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:16.023541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024f47-f8b4-407d-a091-ea933e4f4485 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:16.024240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024f47-f8b4-407d-a091-ea933e4f4485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:16.025000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024f47-f8b4-407d-a091-ea933e4f4485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:16.026002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19024f47-f8b4-407d-a091-ea933e4f4485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:16.027965 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19024f47-f8b4-407d-a091-ea933e4f4485 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:16.053144 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1263/2501] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:16.058059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076ff2b-7673-4ae7-8328-17b44945c069 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:16.071654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076ff2b-7673-4ae7-8328-17b44945c069 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:16.078496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff1e6-0af6-4e7b-ac0c-746c9d10f77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:16.079613 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff1e6-0af6-4e7b-ac0c-746c9d10f77a admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:16.079992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff1e6-0af6-4e7b-ac0c-746c9d10f77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:16.080337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff1e6-0af6-4e7b-ac0c-746c9d10f77a admin admin] PATH_INFO: `/v3/projects/8c43068d41bd43b2a0189aafd14fcdfd/users/c1b63b8c0aad4fd588c386b327e40bdf/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:16.103732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaff1e6-0af6-4e7b-ac0c-746c9d10f77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c43068d41bd43b2a0189aafd14fcdfd, user_id=c1b63b8c0aad4fd588c386b327e40bdf, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:16.107124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaff1e6-0af6-4e7b-ac0c-746c9d10f77a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:16.139696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1239/2502] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:16 2022] PUT /identity/v3/projects/8c43068d41bd43b2a0189aafd14fcdfd/users/c1b63b8c0aad4fd588c386b327e40bdf/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:16.151594 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10a98-542c-4a5c-a1fe-ad760653ceae None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:16.151914 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10a98-542c-4a5c-a1fe-ad760653ceae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:16.152159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10a98-542c-4a5c-a1fe-ad760653ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:16.210024 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5de10a98-542c-4a5c-a1fe-ad760653ceae None None] MFA Rules not processed for user `c1b63b8c0aad4fd588c386b327e40bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:16.211206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5de10a98-542c-4a5c-a1fe-ad760653ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:16.426937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1264/2503] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:16.432694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff1e6-0af6-4e7b-ac0c-746c9d10f77a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:16.524804 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:16.637039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff1e6-0af6-4e7b-ac0c-746c9d10f77a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:16.650317 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0205b-6606-4fc1-b3be-8a0d43c3631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:16.651040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0205b-6606-4fc1-b3be-8a0d43c3631d admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:16.651450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0205b-6606-4fc1-b3be-8a0d43c3631d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:16.651832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0205b-6606-4fc1-b3be-8a0d43c3631d admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:16.652705 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0205b-6606-4fc1-b3be-8a0d43c3631d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:16.657225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0205b-6606-4fc1-b3be-8a0d43c3631d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:16.708906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1240/2504] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:16 2022] POST /identity/v3/projects => generated 371 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:16.712686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de10a98-542c-4a5c-a1fe-ad760653ceae None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:16.732909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de10a98-542c-4a5c-a1fe-ad760653ceae None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:16.882994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098e57-31b7-4bbe-8609-990d7d33f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:16.888318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098e57-31b7-4bbe-8609-990d7d33f3ba admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:16.888690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098e57-31b7-4bbe-8609-990d7d33f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:16.888902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098e57-31b7-4bbe-8609-990d7d33f3ba admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:16.890192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51098e57-31b7-4bbe-8609-990d7d33f3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:16.892729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51098e57-31b7-4bbe-8609-990d7d33f3ba admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:16.940523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1265/2505] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:16 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:16.944437 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0205b-6606-4fc1-b3be-8a0d43c3631d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:16.955365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0205b-6606-4fc1-b3be-8a0d43c3631d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:16.966962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b478d-070c-46ad-91eb-33b9a6c9eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:16.967865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b478d-070c-46ad-91eb-33b9a6c9eb4e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:16.967970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b478d-070c-46ad-91eb-33b9a6c9eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:16.968176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b478d-070c-46ad-91eb-33b9a6c9eb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:16.968831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b478d-070c-46ad-91eb-33b9a6c9eb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:16.970456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b478d-070c-46ad-91eb-33b9a6c9eb4e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:17.004993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1241/2506] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:17.006571 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098e57-31b7-4bbe-8609-990d7d33f3ba admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:17.022467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098e57-31b7-4bbe-8609-990d7d33f3ba admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:17.047637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de02e-33fb-4901-b180-1c0dfed84a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:17.048351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de02e-33fb-4901-b180-1c0dfed84a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:17.048629 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de02e-33fb-4901-b180-1c0dfed84a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:17.048903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de02e-33fb-4901-b180-1c0dfed84a58 admin admin] PATH_INFO: `/v3/projects/218df451a6a44e25a11314d127c42096/users/e24dc16c376e4ba7b08b5ff71e8ff563/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:17.085315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:17.110968 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2de02e-33fb-4901-b180-1c0dfed84a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=218df451a6a44e25a11314d127c42096, user_id=e24dc16c376e4ba7b08b5ff71e8ff563, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:17.113729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2de02e-33fb-4901-b180-1c0dfed84a58 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:17.164874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1266/2507] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:17 2022] PUT /identity/v3/projects/218df451a6a44e25a11314d127c42096/users/e24dc16c376e4ba7b08b5ff71e8ff563/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:17.165969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b478d-070c-46ad-91eb-33b9a6c9eb4e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:17.188206 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b478d-070c-46ad-91eb-33b9a6c9eb4e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:17.373557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458a8b0-93cb-4504-8ce3-3d1e3f9caa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:17.374447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458a8b0-93cb-4504-8ce3-3d1e3f9caa99 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:17.374873 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458a8b0-93cb-4504-8ce3-3d1e3f9caa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:17.375293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458a8b0-93cb-4504-8ce3-3d1e3f9caa99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:17.376773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458a8b0-93cb-4504-8ce3-3d1e3f9caa99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:17.382190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458a8b0-93cb-4504-8ce3-3d1e3f9caa99 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:17.407964 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1242/2508] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:17.414654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de02e-33fb-4901-b180-1c0dfed84a58 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:17.436541 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de02e-33fb-4901-b180-1c0dfed84a58 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:17.454360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ddabf-72cb-4b76-9d02-6549c07c4f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:17.460149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ddabf-72cb-4b76-9d02-6549c07c4f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:17.460762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ddabf-72cb-4b76-9d02-6549c07c4f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:17.462466 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ddabf-72cb-4b76-9d02-6549c07c4f1e admin admin] PATH_INFO: `/v3/projects/218df451a6a44e25a11314d127c42096/users/e24dc16c376e4ba7b08b5ff71e8ff563/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:17.479983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ddabf-72cb-4b76-9d02-6549c07c4f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=218df451a6a44e25a11314d127c42096, user_id=e24dc16c376e4ba7b08b5ff71e8ff563, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:17.493754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ddabf-72cb-4b76-9d02-6549c07c4f1e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:17.526451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1267/2509] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:17 2022] PUT /identity/v3/projects/218df451a6a44e25a11314d127c42096/users/e24dc16c376e4ba7b08b5ff71e8ff563/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:17.538785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d038946-fad8-448c-9af8-8ed05e87cd4a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:17.539775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d038946-fad8-448c-9af8-8ed05e87cd4a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:17.539775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d038946-fad8-448c-9af8-8ed05e87cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:17.617914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5d038946-fad8-448c-9af8-8ed05e87cd4a None None] MFA Rules not processed for user `e24dc16c376e4ba7b08b5ff71e8ff563`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:17.623609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5d038946-fad8-448c-9af8-8ed05e87cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:17.772680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1243/2510] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:17.787036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ddabf-72cb-4b76-9d02-6549c07c4f1e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:17.789493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-915ddabf-72cb-4b76-9d02-6549c07c4f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:17.997010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ddabf-72cb-4b76-9d02-6549c07c4f1e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:18.014382 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec1f1-534c-4705-b31c-472bc73e70d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:18.015661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec1f1-534c-4705-b31c-472bc73e70d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:18.015938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec1f1-534c-4705-b31c-472bc73e70d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:18.016209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec1f1-534c-4705-b31c-472bc73e70d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:18.029000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ec1f1-534c-4705-b31c-472bc73e70d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:18.031357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ec1f1-534c-4705-b31c-472bc73e70d8 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:18.043517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1268/2511] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:18.290072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d038946-fad8-448c-9af8-8ed05e87cd4a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:18.293048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5d038946-fad8-448c-9af8-8ed05e87cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:18.327574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:18.375198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d038946-fad8-448c-9af8-8ed05e87cd4a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:18.379786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:18.380616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:18.381071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:18.381487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] PATH_INFO: `/v3/users/cedf7db74e0d4ca181b41a3f3ba6e7ab` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:18.383044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedf7db74e0d4ca181b41a3f3ba6e7ab)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:18.385297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:18.448325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedf7db74e0d4ca181b41a3f3ba6e7ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.449236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedf7db74e0d4ca181b41a3f3ba6e7ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.459616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedf7db74e0d4ca181b41a3f3ba6e7ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.479274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedf7db74e0d4ca181b41a3f3ba6e7ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.490374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedf7db74e0d4ca181b41a3f3ba6e7ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.501113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1244/2512] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:18 2022] DELETE /identity/v3/users/cedf7db74e0d4ca181b41a3f3ba6e7ab => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:18.595755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec1f1-534c-4705-b31c-472bc73e70d8 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:18.607123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec1f1-534c-4705-b31c-472bc73e70d8 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:18.740631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:18.746494 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:18.749655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:18.750374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] PATH_INFO: `/v3/users/c1b63b8c0aad4fd588c386b327e40bdf` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:18.751801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b63b8c0aad4fd588c386b327e40bdf)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:18.754596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:18.801078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:18.811501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:18.834375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fb2c2-65dc-4b39-97ff-01271e017d31 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:18.839212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:18.839885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:18.840150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:18.840418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] PATH_INFO: `/v3/projects/a3773bfb98954a4dabb5eeb46e2738b1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:18.842015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3773bfb98954a4dabb5eeb46e2738b1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:18.843987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:18.879167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b63b8c0aad4fd588c386b327e40bdf'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.888731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b63b8c0aad4fd588c386b327e40bdf'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.903063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b63b8c0aad4fd588c386b327e40bdf'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.904556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b63b8c0aad4fd588c386b327e40bdf'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.905650 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:18.913651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-29b3b5f1-bdbc-4ac8-8268-de3346a30281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b63b8c0aad4fd588c386b327e40bdf'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.915855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3773bfb98954a4dabb5eeb46e2738b1', 'request_id': 'req-a5ad32ec-a234-435c-afa4-953d0daa08ac'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.923647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1269/2513] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:18 2022] DELETE /identity/v3/users/c1b63b8c0aad4fd588c386b327e40bdf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:18.927273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1321ee-eccf-42ce-a8d9-c36aefa47bb0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:18.927596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1321ee-eccf-42ce-a8d9-c36aefa47bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:18.927899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1321ee-eccf-42ce-a8d9-c36aefa47bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:18.929872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3773bfb98954a4dabb5eeb46e2738b1', 'request_id': 'req-a5ad32ec-a234-435c-afa4-953d0daa08ac'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.938026 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3773bfb98954a4dabb5eeb46e2738b1', 'request_id': 'req-a5ad32ec-a234-435c-afa4-953d0daa08ac'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.953696 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1b1321ee-eccf-42ce-a8d9-c36aefa47bb0 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:18.954962 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1b1321ee-eccf-42ce-a8d9-c36aefa47bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:18.957417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] The token cache is being invalidate because project a3773bfb98954a4dabb5eeb46e2738b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:18.957814 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.971912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:18.975442 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1245/2514] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:18 2022] DELETE /identity/v3/projects/a3773bfb98954a4dabb5eeb46e2738b1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:18.986086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:18.999883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:19.035165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:19.085768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1270/2515] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:19.108688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1321ee-eccf-42ce-a8d9-c36aefa47bb0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:19.112142 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad32ec-a234-435c-afa4-953d0daa08ac admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:19.112295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1b1321ee-eccf-42ce-a8d9-c36aefa47bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:19.116538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:19.117185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:19.117461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:19.117718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] PATH_INFO: `/v3/users/f8f277a284cf4ed090d2e2a8999a668c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:19.119431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f277a284cf4ed090d2e2a8999a668c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:19.121350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:19.220405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1321ee-eccf-42ce-a8d9-c36aefa47bb0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:19.224418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14535329-a862-4df6-bf67-9b5f2e2bb2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:19.225740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14535329-a862-4df6-bf67-9b5f2e2bb2fb service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:19.225740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14535329-a862-4df6-bf67-9b5f2e2bb2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:19.225740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14535329-a862-4df6-bf67-9b5f2e2bb2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:19.236119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f277a284cf4ed090d2e2a8999a668c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.237144 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f277a284cf4ed090d2e2a8999a668c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.237791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14535329-a862-4df6-bf67-9b5f2e2bb2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:19.239390 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14535329-a862-4df6-bf67-9b5f2e2bb2fb service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:19.251371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f277a284cf4ed090d2e2a8999a668c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.252608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1271/2516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:19.267665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f277a284cf4ed090d2e2a8999a668c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.276021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f277a284cf4ed090d2e2a8999a668c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.286566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1246/2517] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:18 2022] DELETE /identity/v3/users/f8f277a284cf4ed090d2e2a8999a668c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:19.589894 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14535329-a862-4df6-bf67-9b5f2e2bb2fb service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:19.604864 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14535329-a862-4df6-bf67-9b5f2e2bb2fb service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:19.694597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:19.696497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:19.702053 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:19.702788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:19.703282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:19.703695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] PATH_INFO: `/v3/projects/a001c37333734d469eba3e9ee374cebb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:19.704872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a001c37333734d469eba3e9ee374cebb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:19.715592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7d180-5f2c-40ad-a007-4258b908280a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:19.718381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:19.727727 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:19.728879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:19.729325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:19.729675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] PATH_INFO: `/v3/projects/8c43068d41bd43b2a0189aafd14fcdfd` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:19.732090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c43068d41bd43b2a0189aafd14fcdfd)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:19.732798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:19.737021 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:19.788197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a001c37333734d469eba3e9ee374cebb', 'request_id': 'req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.806606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a001c37333734d469eba3e9ee374cebb', 'request_id': 'req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.808396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c43068d41bd43b2a0189aafd14fcdfd', 'request_id': 'req-d5e72bfc-de4c-4cf3-85f6-1486960ad833'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.819407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a001c37333734d469eba3e9ee374cebb', 'request_id': 'req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.823631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c43068d41bd43b2a0189aafd14fcdfd', 'request_id': 'req-d5e72bfc-de4c-4cf3-85f6-1486960ad833'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.830506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c43068d41bd43b2a0189aafd14fcdfd', 'request_id': 'req-d5e72bfc-de4c-4cf3-85f6-1486960ad833'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.832398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] The token cache is being invalidate because project a001c37333734d469eba3e9ee374cebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:19.832763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.833455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.835185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1272/2518] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:19 2022] DELETE /identity/v3/projects/a001c37333734d469eba3e9ee374cebb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:19.842535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] The token cache is being invalidate because project 8c43068d41bd43b2a0189aafd14fcdfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:19.842922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.843780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:19.845365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1247/2519] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:19 2022] DELETE /identity/v3/projects/8c43068d41bd43b2a0189aafd14fcdfd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:19.850113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:19.851760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:19.948292 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cd7ce-f9ac-49b5-8964-27c075f26a93 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:20.028892 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:20.029631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:20.029974 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:20.030402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] PATH_INFO: `/v3/users/e24dc16c376e4ba7b08b5ff71e8ff563` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:20.031724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24dc16c376e4ba7b08b5ff71e8ff563)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:20.034011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:20.102480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24dc16c376e4ba7b08b5ff71e8ff563'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:20.104822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:20.115646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24dc16c376e4ba7b08b5ff71e8ff563'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:20.131091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24dc16c376e4ba7b08b5ff71e8ff563'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:20.131843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24dc16c376e4ba7b08b5ff71e8ff563'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:20.138949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c51ed06a-fe07-4637-92d0-83da5c9ecba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24dc16c376e4ba7b08b5ff71e8ff563'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:20.144839 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1273/2520] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:19 2022] DELETE /identity/v3/users/e24dc16c376e4ba7b08b5ff71e8ff563 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:20.444478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:20.446093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:20.463428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e72bfc-de4c-4cf3-85f6-1486960ad833 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:20.491979 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:20.526394 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:20.527029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:20.527358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:20.527606 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] PATH_INFO: `/v3/projects/218df451a6a44e25a11314d127c42096` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:20.528815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=218df451a6a44e25a11314d127c42096)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:20.530922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:20.586020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218df451a6a44e25a11314d127c42096', 'request_id': 'req-c41a7727-8b0e-4ff4-b2ea-b71685467423'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:20.594428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218df451a6a44e25a11314d127c42096', 'request_id': 'req-c41a7727-8b0e-4ff4-b2ea-b71685467423'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:20.600084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218df451a6a44e25a11314d127c42096', 'request_id': 'req-c41a7727-8b0e-4ff4-b2ea-b71685467423'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:20.611217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] The token cache is being invalidate because project 218df451a6a44e25a11314d127c42096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:20.611593 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:20.612216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c41a7727-8b0e-4ff4-b2ea-b71685467423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:20.613693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1248/2521] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:20 2022] DELETE /identity/v3/projects/218df451a6a44e25a11314d127c42096 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:20.618742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d495f-c141-4496-957f-a02129dc1ad5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:20.619208 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d495f-c141-4496-957f-a02129dc1ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:20.619321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d495f-c141-4496-957f-a02129dc1ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:20.640348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f19d495f-c141-4496-957f-a02129dc1ad5 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:20.641550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f19d495f-c141-4496-957f-a02129dc1ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:20.704349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1274/2522] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:20.712512 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a0307-0913-4ec3-a5c3-ec1171767019 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:20.713087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a0307-0913-4ec3-a5c3-ec1171767019 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:20.713087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a0307-0913-4ec3-a5c3-ec1171767019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:20.736525 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-779a0307-0913-4ec3-a5c3-ec1171767019 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:20.737749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-779a0307-0913-4ec3-a5c3-ec1171767019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:20.746077 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1249/2523] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:20.751011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d495f-c141-4496-957f-a02129dc1ad5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:20.761384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d495f-c141-4496-957f-a02129dc1ad5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:20.767296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a891c-edd0-45ab-a9d8-cbb3542f4c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:20.767947 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a891c-edd0-45ab-a9d8-cbb3542f4c03 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:20.768223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a891c-edd0-45ab-a9d8-cbb3542f4c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:20.768492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a891c-edd0-45ab-a9d8-cbb3542f4c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:20.769148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a891c-edd0-45ab-a9d8-cbb3542f4c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:41:20.769452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a891c-edd0-45ab-a9d8-cbb3542f4c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:20.771067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a891c-edd0-45ab-a9d8-cbb3542f4c03 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:20.783927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1275/2524] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:41:20.788408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a0307-0913-4ec3-a5c3-ec1171767019 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:20.797991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a0307-0913-4ec3-a5c3-ec1171767019 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:20.802832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cfe4c-0a71-4fae-998f-2ef4d45633e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:20.803554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cfe4c-0a71-4fae-998f-2ef4d45633e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:20.803832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cfe4c-0a71-4fae-998f-2ef4d45633e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:20.804101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cfe4c-0a71-4fae-998f-2ef4d45633e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:20.804755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cfe4c-0a71-4fae-998f-2ef4d45633e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:20.806656 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cfe4c-0a71-4fae-998f-2ef4d45633e7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:20.834550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1250/2525] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:20 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:20.838832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a891c-edd0-45ab-a9d8-cbb3542f4c03 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:20.849105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a891c-edd0-45ab-a9d8-cbb3542f4c03 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:20.917219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2ef48-38d8-4709-9b88-4808649e9a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:20.917835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2ef48-38d8-4709-9b88-4808649e9a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:20.918115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2ef48-38d8-4709-9b88-4808649e9a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:20.918407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2ef48-38d8-4709-9b88-4808649e9a4f admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:20.919013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2ef48-38d8-4709-9b88-4808649e9a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:20.921070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2ef48-38d8-4709-9b88-4808649e9a4f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:20.943615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1276/2526] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:20 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:20.947830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cfe4c-0a71-4fae-998f-2ef4d45633e7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:20.959008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cfe4c-0a71-4fae-998f-2ef4d45633e7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:20.964455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e991-a03d-46ea-9a51-5371afbd605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:20.965065 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e991-a03d-46ea-9a51-5371afbd605b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:20.965372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e991-a03d-46ea-9a51-5371afbd605b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:20.965635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e991-a03d-46ea-9a51-5371afbd605b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:20.966600 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e991-a03d-46ea-9a51-5371afbd605b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:20.968247 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e991-a03d-46ea-9a51-5371afbd605b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:20.978686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1251/2527] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:20.983179 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2ef48-38d8-4709-9b88-4808649e9a4f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:20.993728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2ef48-38d8-4709-9b88-4808649e9a4f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:20.998885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00948de-77de-475f-bb66-41b57c7dcf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:20.999527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00948de-77de-475f-bb66-41b57c7dcf90 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:20.999803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00948de-77de-475f-bb66-41b57c7dcf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.000070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00948de-77de-475f-bb66-41b57c7dcf90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.000719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00948de-77de-475f-bb66-41b57c7dcf90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:21.002313 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00948de-77de-475f-bb66-41b57c7dcf90 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:21.014197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1277/2528] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:21.018899 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e991-a03d-46ea-9a51-5371afbd605b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:21.029457 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e991-a03d-46ea-9a51-5371afbd605b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:21.034587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa7791-cc6b-45fa-8b71-4eb6c2c45b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:21.035240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa7791-cc6b-45fa-8b71-4eb6c2c45b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.035547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa7791-cc6b-45fa-8b71-4eb6c2c45b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.035819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa7791-cc6b-45fa-8b71-4eb6c2c45b8e admin admin] PATH_INFO: `/v3/projects/bbb9ac73d6774429af83a22a9b107b5f/users/1280a532ad89455290e9c02d47fcc0fc/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.051821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa7791-cc6b-45fa-8b71-4eb6c2c45b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb9ac73d6774429af83a22a9b107b5f, user_id=1280a532ad89455290e9c02d47fcc0fc, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:21.054471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa7791-cc6b-45fa-8b71-4eb6c2c45b8e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:21.068751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1252/2529] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:21 2022] PUT /identity/v3/projects/bbb9ac73d6774429af83a22a9b107b5f/users/1280a532ad89455290e9c02d47fcc0fc/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:21.081714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5626-3282-46dd-8479-0cce11090fb8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.082002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5626-3282-46dd-8479-0cce11090fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.082272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5626-3282-46dd-8479-0cce11090fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.112938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f56d5626-3282-46dd-8479-0cce11090fb8 None None] MFA Rules not processed for user `1280a532ad89455290e9c02d47fcc0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:21.114094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f56d5626-3282-46dd-8479-0cce11090fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:21.133751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:21.189115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1278/2530] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:21.193698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa7791-cc6b-45fa-8b71-4eb6c2c45b8e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:21.260015 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:21.274754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa7791-cc6b-45fa-8b71-4eb6c2c45b8e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:21.280837 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd570a-968c-4c6e-87d4-679cfbe0716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:21.281455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd570a-968c-4c6e-87d4-679cfbe0716e admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.281726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd570a-968c-4c6e-87d4-679cfbe0716e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.281993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd570a-968c-4c6e-87d4-679cfbe0716e admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.282641 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd570a-968c-4c6e-87d4-679cfbe0716e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:21.284660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd570a-968c-4c6e-87d4-679cfbe0716e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:21.328042 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1253/2531] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:21 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:21.328273 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d5626-3282-46dd-8479-0cce11090fb8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:21.338749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d5626-3282-46dd-8479-0cce11090fb8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:21.399323 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9295b6b-c580-4e85-95d0-43eac3dab723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:21.399955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9295b6b-c580-4e85-95d0-43eac3dab723 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.400234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9295b6b-c580-4e85-95d0-43eac3dab723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.400504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9295b6b-c580-4e85-95d0-43eac3dab723 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.401153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9295b6b-c580-4e85-95d0-43eac3dab723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:21.403068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9295b6b-c580-4e85-95d0-43eac3dab723 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:21.425480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1279/2532] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:21 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:41:21.429706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd570a-968c-4c6e-87d4-679cfbe0716e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:21.440974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd570a-968c-4c6e-87d4-679cfbe0716e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:21.459080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e38a0-7ca2-4fe1-946f-26829c056182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:21.459080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e38a0-7ca2-4fe1-946f-26829c056182 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.459537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e38a0-7ca2-4fe1-946f-26829c056182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.459638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e38a0-7ca2-4fe1-946f-26829c056182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.460273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e38a0-7ca2-4fe1-946f-26829c056182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:21.461905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e38a0-7ca2-4fe1-946f-26829c056182 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:21.473882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1254/2533] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:21.479955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9295b6b-c580-4e85-95d0-43eac3dab723 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:21.490699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9295b6b-c580-4e85-95d0-43eac3dab723 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:21.495803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dbf88-b982-4407-9c5c-546df5654fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:21.496467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dbf88-b982-4407-9c5c-546df5654fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.496792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dbf88-b982-4407-9c5c-546df5654fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.497358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dbf88-b982-4407-9c5c-546df5654fb9 admin admin] PATH_INFO: `/v3/projects/c9184597af094b789edca5e2d32933f5/users/3d3c0aa9a05e4ad899e09c0c3971ce8a/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.513137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dbf88-b982-4407-9c5c-546df5654fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9184597af094b789edca5e2d32933f5, user_id=3d3c0aa9a05e4ad899e09c0c3971ce8a, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:21.515851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dbf88-b982-4407-9c5c-546df5654fb9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:21.531392 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1280/2534] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:21 2022] PUT /identity/v3/projects/c9184597af094b789edca5e2d32933f5/users/3d3c0aa9a05e4ad899e09c0c3971ce8a/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:21.535864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e38a0-7ca2-4fe1-946f-26829c056182 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:21.547756 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e38a0-7ca2-4fe1-946f-26829c056182 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:21.608295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33b544-6ca3-48b4-9f72-af14900474c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:21.608909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33b544-6ca3-48b4-9f72-af14900474c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.609179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33b544-6ca3-48b4-9f72-af14900474c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.609445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33b544-6ca3-48b4-9f72-af14900474c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.610118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33b544-6ca3-48b4-9f72-af14900474c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:21.612114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33b544-6ca3-48b4-9f72-af14900474c5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:21.622474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1255/2535] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:21.626716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dbf88-b982-4407-9c5c-546df5654fb9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:21.637461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dbf88-b982-4407-9c5c-546df5654fb9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:21.642471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645aa4f-d3e4-413f-a97b-a16a329bcc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:21.645757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645aa4f-d3e4-413f-a97b-a16a329bcc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.645757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645aa4f-d3e4-413f-a97b-a16a329bcc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.645757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645aa4f-d3e4-413f-a97b-a16a329bcc6e admin admin] PATH_INFO: `/v3/projects/c9184597af094b789edca5e2d32933f5/users/3d3c0aa9a05e4ad899e09c0c3971ce8a/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.649232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645aa4f-d3e4-413f-a97b-a16a329bcc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9184597af094b789edca5e2d32933f5, user_id=3d3c0aa9a05e4ad899e09c0c3971ce8a, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:21.649600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645aa4f-d3e4-413f-a97b-a16a329bcc6e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:21.662479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1281/2536] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:21 2022] PUT /identity/v3/projects/c9184597af094b789edca5e2d32933f5/users/3d3c0aa9a05e4ad899e09c0c3971ce8a/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:21.673275 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb081833-15c1-4865-a90e-b15fb9f8dd01 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.673665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb081833-15c1-4865-a90e-b15fb9f8dd01 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.674001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb081833-15c1-4865-a90e-b15fb9f8dd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.690215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645aa4f-d3e4-413f-a97b-a16a329bcc6e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:21.692131 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8645aa4f-d3e4-413f-a97b-a16a329bcc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:21.710292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-eb081833-15c1-4865-a90e-b15fb9f8dd01 None None] MFA Rules not processed for user `3d3c0aa9a05e4ad899e09c0c3971ce8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:21.711527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-eb081833-15c1-4865-a90e-b15fb9f8dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:21.758139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645aa4f-d3e4-413f-a97b-a16a329bcc6e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:21.761812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf6e0d-8e8b-4cd8-a68d-a460d7263c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:21.762426 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6e0d-8e8b-4cd8-a68d-a460d7263c52 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.762716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6e0d-8e8b-4cd8-a68d-a460d7263c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.763000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6e0d-8e8b-4cd8-a68d-a460d7263c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.764818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2caf6e0d-8e8b-4cd8-a68d-a460d7263c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:21.783454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1256/2537] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:21.792948 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:21.795025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb081833-15c1-4865-a90e-b15fb9f8dd01 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:21.796531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-eb081833-15c1-4865-a90e-b15fb9f8dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:21.831525 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf6e0d-8e8b-4cd8-a68d-a460d7263c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:21.832972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf6e0d-8e8b-4cd8-a68d-a460d7263c52 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:21.842765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1282/2538] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:21.847838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:21.851926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb081833-15c1-4865-a90e-b15fb9f8dd01 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:21.856624 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddfbd9-8cde-49b3-b9f3-dbec2734a1e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:21.857330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddfbd9-8cde-49b3-b9f3-dbec2734a1e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.857640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddfbd9-8cde-49b3-b9f3-dbec2734a1e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.857931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddfbd9-8cde-49b3-b9f3-dbec2734a1e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:21.868006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddfbd9-8cde-49b3-b9f3-dbec2734a1e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:21.869456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddfbd9-8cde-49b3-b9f3-dbec2734a1e3 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:21.879482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1257/2539] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:21.958176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf6e0d-8e8b-4cd8-a68d-a460d7263c52 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:21.968146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf6e0d-8e8b-4cd8-a68d-a460d7263c52 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:21.972007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af5acf-85e9-462a-8543-99768058d285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:21.972689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5acf-85e9-462a-8543-99768058d285 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:21.973041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5acf-85e9-462a-8543-99768058d285 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:21.973380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5acf-85e9-462a-8543-99768058d285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:22.033357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af5acf-85e9-462a-8543-99768058d285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:22.034933 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af5acf-85e9-462a-8543-99768058d285 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:22.044473 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1283/2540] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:24.699488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff297a-5564-44f8-8298-ee1d5f75aad2 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:24.700431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff297a-5564-44f8-8298-ee1d5f75aad2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:24.700431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff297a-5564-44f8-8298-ee1d5f75aad2 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:24.701410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1258/2541] 10.222.0.20 () {54 vars in 921 bytes} [Thu Oct 6 04:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 04:41:24.707945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b8b1c-5129-4385-a26d-8a8eca5c02cf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:24.708474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b8b1c-5129-4385-a26d-8a8eca5c02cf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:24.708474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b8b1c-5129-4385-a26d-8a8eca5c02cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:24.752847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9f8b8b1c-5129-4385-a26d-8a8eca5c02cf None None] MFA Rules not processed for user `0481d4c0be0b46189e339d1e00bee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:24.754593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9f8b8b1c-5129-4385-a26d-8a8eca5c02cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:24.896886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1284/2542] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Oct 6 04:41:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:24.918853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff297a-5564-44f8-8298-ee1d5f75aad2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:24.920097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b4ff297a-5564-44f8-8298-ee1d5f75aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:25.021340 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff297a-5564-44f8-8298-ee1d5f75aad2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:25.026062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662e909-c1d1-4756-950b-b3d0d4d939e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '457880195ed849d2b594ddea6acdf7df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:25.027027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662e909-c1d1-4756-950b-b3d0d4d939e8 service glance] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:25.027470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662e909-c1d1-4756-950b-b3d0d4d939e8 service glance] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:25.027859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662e909-c1d1-4756-950b-b3d0d4d939e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:25.045950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b8b1c-5129-4385-a26d-8a8eca5c02cf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:25.056668 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662e909-c1d1-4756-950b-b3d0d4d939e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:25.059670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662e909-c1d1-4756-950b-b3d0d4d939e8 service glance] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:25.064498 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b8b1c-5129-4385-a26d-8a8eca5c02cf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:25.070008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:25.071045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:25.074702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:25.074702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] PATH_INFO: `/v3/users/1280a532ad89455290e9c02d47fcc0fc` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:25.075379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1280a532ad89455290e9c02d47fcc0fc)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:25.077303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:25.078821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1259/2543] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:25.126884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:25.151949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1280a532ad89455290e9c02d47fcc0fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.169037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1280a532ad89455290e9c02d47fcc0fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.190927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1280a532ad89455290e9c02d47fcc0fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.192046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1280a532ad89455290e9c02d47fcc0fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.199395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662e909-c1d1-4756-950b-b3d0d4d939e8 service glance] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:25.200969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5662e909-c1d1-4756-950b-b3d0d4d939e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:25.205038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b1d4fd0-349d-4e54-917c-e9ea5597ad36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1280a532ad89455290e9c02d47fcc0fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.211485 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1285/2544] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:25 2022] DELETE /identity/v3/users/1280a532ad89455290e9c02d47fcc0fc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:25.217536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccc111-4ef5-427f-8fc5-035d4e68fc89 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:25.217823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccc111-4ef5-427f-8fc5-035d4e68fc89 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:25.218102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccc111-4ef5-427f-8fc5-035d4e68fc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:25.231410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662e909-c1d1-4756-950b-b3d0d4d939e8 service glance] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:25.245704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ecccc111-4ef5-427f-8fc5-035d4e68fc89 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:25.247415 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ecccc111-4ef5-427f-8fc5-035d4e68fc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:25.300609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:25.301280 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:25.301615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:25.301909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] PATH_INFO: `/v3/users/deea84058f724ff3b78caa9d8b010202` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:25.303115 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deea84058f724ff3b78caa9d8b010202)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:25.310004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:25.317505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1286/2545] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:25.327360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccc111-4ef5-427f-8fc5-035d4e68fc89 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:25.328869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ecccc111-4ef5-427f-8fc5-035d4e68fc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:25.376093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deea84058f724ff3b78caa9d8b010202'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.376772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deea84058f724ff3b78caa9d8b010202'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.391048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deea84058f724ff3b78caa9d8b010202'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.399364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccc111-4ef5-427f-8fc5-035d4e68fc89 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:25.404031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b033-1d69-4148-8cf1-264d9e2e5b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:25.404895 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b033-1d69-4148-8cf1-264d9e2e5b84 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:25.405302 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b033-1d69-4148-8cf1-264d9e2e5b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:25.405773 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b033-1d69-4148-8cf1-264d9e2e5b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:25.407742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-12f4b033-1d69-4148-8cf1-264d9e2e5b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:25.410014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deea84058f724ff3b78caa9d8b010202'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.423352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deea84058f724ff3b78caa9d8b010202'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.429001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4b033-1d69-4148-8cf1-264d9e2e5b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:25.433475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4b033-1d69-4148-8cf1-264d9e2e5b84 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:25.433938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1260/2546] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:25 2022] DELETE /identity/v3/users/deea84058f724ff3b78caa9d8b010202 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:25.442420 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1287/2547] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:25.680116 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:25.681555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:25.698019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:25.775062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97d20-c7a7-4e8e-b391-4fe1f6c1b1f4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:25.780280 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:25.781059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b033-1d69-4148-8cf1-264d9e2e5b84 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:25.781705 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:25.782058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:25.782333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] PATH_INFO: `/v3/projects/4ce37172c0c34b8e9f342775a6b8ebdb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:25.783749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-12f4b033-1d69-4148-8cf1-264d9e2e5b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:25.783969 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce37172c0c34b8e9f342775a6b8ebdb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:25.785879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:25.803675 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b033-1d69-4148-8cf1-264d9e2e5b84 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:25.808860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:25.809688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:25.810171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:25.810709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] PATH_INFO: `/v3/projects/bbb9ac73d6774429af83a22a9b107b5f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:25.813162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb9ac73d6774429af83a22a9b107b5f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:25.815892 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:25.843156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce37172c0c34b8e9f342775a6b8ebdb', 'request_id': 'req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.853993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce37172c0c34b8e9f342775a6b8ebdb', 'request_id': 'req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.861411 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce37172c0c34b8e9f342775a6b8ebdb', 'request_id': 'req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.869571 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:25.874287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb9ac73d6774429af83a22a9b107b5f', 'request_id': 'req-dabebbc1-feb7-4c73-89f6-e32487c27273'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.874482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] The token cache is being invalidate because project 4ce37172c0c34b8e9f342775a6b8ebdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:25.874780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.875687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e85ca6f8-d62c-40ed-a6f5-f8d15430377f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.881263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1261/2548] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:25 2022] DELETE /identity/v3/projects/4ce37172c0c34b8e9f342775a6b8ebdb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:25.883225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056b60-3392-45e1-89c6-bc531c9fa344 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:25.883587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056b60-3392-45e1-89c6-bc531c9fa344 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:25.883908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056b60-3392-45e1-89c6-bc531c9fa344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:25.885467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb9ac73d6774429af83a22a9b107b5f', 'request_id': 'req-dabebbc1-feb7-4c73-89f6-e32487c27273'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.891907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb9ac73d6774429af83a22a9b107b5f', 'request_id': 'req-dabebbc1-feb7-4c73-89f6-e32487c27273'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.902988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] The token cache is being invalidate because project bbb9ac73d6774429af83a22a9b107b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:25.903414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.903753 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a4056b60-3392-45e1-89c6-bc531c9fa344 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:25.904150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:25.904957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a4056b60-3392-45e1-89c6-bc531c9fa344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:25.905722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1288/2549] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:25 2022] DELETE /identity/v3/projects/bbb9ac73d6774429af83a22a9b107b5f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:25.909620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:25.911139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:25.976449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1262/2550] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:25.984982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227db8-df16-4df3-b70b-25e64e1a843c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:25.985422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227db8-df16-4df3-b70b-25e64e1a843c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:25.986068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227db8-df16-4df3-b70b-25e64e1a843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.001622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabebbc1-feb7-4c73-89f6-e32487c27273 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.006534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.007176 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.007491 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.007750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-15227db8-df16-4df3-b70b-25e64e1a843c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:26.007872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] PATH_INFO: `/v3/users/3d3c0aa9a05e4ad899e09c0c3971ce8a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.008871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3c0aa9a05e4ad899e09c0c3971ce8a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.009084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-15227db8-df16-4df3-b70b-25e64e1a843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:26.010779 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.018159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1263/2551] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:26.022372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15227db8-df16-4df3-b70b-25e64e1a843c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.031754 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15227db8-df16-4df3-b70b-25e64e1a843c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.037034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dad34-71e8-4b31-b9db-bfb6ff4d0502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.037688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dad34-71e8-4b31-b9db-bfb6ff4d0502 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.037963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dad34-71e8-4b31-b9db-bfb6ff4d0502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.038240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dad34-71e8-4b31-b9db-bfb6ff4d0502 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.038881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dad34-71e8-4b31-b9db-bfb6ff4d0502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:41:26.039176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dad34-71e8-4b31-b9db-bfb6ff4d0502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.040841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dad34-71e8-4b31-b9db-bfb6ff4d0502 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.054263 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1264/2552] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:41:26.059723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dad34-71e8-4b31-b9db-bfb6ff4d0502 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.071686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dad34-71e8-4b31-b9db-bfb6ff4d0502 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.072500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3c0aa9a05e4ad899e09c0c3971ce8a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:26.078846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1694f4-1b0c-4b08-bcc9-ee5923c7594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.079502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1694f4-1b0c-4b08-bcc9-ee5923c7594f admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.079807 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1694f4-1b0c-4b08-bcc9-ee5923c7594f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.080095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1694f4-1b0c-4b08-bcc9-ee5923c7594f admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.080677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1694f4-1b0c-4b08-bcc9-ee5923c7594f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.081747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3c0aa9a05e4ad899e09c0c3971ce8a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:26.082577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1694f4-1b0c-4b08-bcc9-ee5923c7594f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.098519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3c0aa9a05e4ad899e09c0c3971ce8a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:26.099713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3c0aa9a05e4ad899e09c0c3971ce8a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:26.108966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3c0aa9a05e4ad899e09c0c3971ce8a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:26.115807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1289/2553] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:25 2022] DELETE /identity/v3/users/3d3c0aa9a05e4ad899e09c0c3971ce8a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:26.120706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1265/2554] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:26 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:26.122161 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.123848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:26.191785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:26.211818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb95f2-f9a4-43ac-8965-7143d112cca0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.275264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c6be-cfb0-4296-971a-3226035509dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.275922 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c6be-cfb0-4296-971a-3226035509dc admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.276376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c6be-cfb0-4296-971a-3226035509dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.276657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c6be-cfb0-4296-971a-3226035509dc admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.277455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797c6be-cfb0-4296-971a-3226035509dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.279375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797c6be-cfb0-4296-971a-3226035509dc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.307360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1290/2555] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:26 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:26.312339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1694f4-1b0c-4b08-bcc9-ee5923c7594f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.318037 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:26.333741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1694f4-1b0c-4b08-bcc9-ee5923c7594f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.338972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd456f1a-514f-4e45-bfde-c0d3c937eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.339742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd456f1a-514f-4e45-bfde-c0d3c937eedf admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.340014 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd456f1a-514f-4e45-bfde-c0d3c937eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.340280 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd456f1a-514f-4e45-bfde-c0d3c937eedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.341174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd456f1a-514f-4e45-bfde-c0d3c937eedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.342826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd456f1a-514f-4e45-bfde-c0d3c937eedf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.356695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1266/2556] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:26.360837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c6be-cfb0-4296-971a-3226035509dc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.371227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c6be-cfb0-4296-971a-3226035509dc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.376162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1834a3-f8ea-4d92-bbd5-f6b9a55dcac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.377009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1834a3-f8ea-4d92-bbd5-f6b9a55dcac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.377295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1834a3-f8ea-4d92-bbd5-f6b9a55dcac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.377583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1834a3-f8ea-4d92-bbd5-f6b9a55dcac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.378232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1834a3-f8ea-4d92-bbd5-f6b9a55dcac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.379872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1834a3-f8ea-4d92-bbd5-f6b9a55dcac9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.390660 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1291/2557] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:26.394966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd456f1a-514f-4e45-bfde-c0d3c937eedf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.408060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd456f1a-514f-4e45-bfde-c0d3c937eedf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.413827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e20e54-3a66-4ea8-96cd-fe9615bb98aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.414644 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e20e54-3a66-4ea8-96cd-fe9615bb98aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.414925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e20e54-3a66-4ea8-96cd-fe9615bb98aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.415209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e20e54-3a66-4ea8-96cd-fe9615bb98aa admin admin] PATH_INFO: `/v3/projects/1a2c2406e8c8451a9560fb4ebe12b8a1/users/561ee8a38e3a450b9210bbcb7e9cd582/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.432856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1834a3-f8ea-4d92-bbd5-f6b9a55dcac9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.434939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0d1834a3-f8ea-4d92-bbd5-f6b9a55dcac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:26.437681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e20e54-3a66-4ea8-96cd-fe9615bb98aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2c2406e8c8451a9560fb4ebe12b8a1, user_id=561ee8a38e3a450b9210bbcb7e9cd582, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.442087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e20e54-3a66-4ea8-96cd-fe9615bb98aa admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.448593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1834a3-f8ea-4d92-bbd5-f6b9a55dcac9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.454327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.455094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.455402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.455677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] PATH_INFO: `/v3/projects/c9184597af094b789edca5e2d32933f5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.456900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9184597af094b789edca5e2d32933f5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.458851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.469098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1267/2558] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:26 2022] PUT /identity/v3/projects/1a2c2406e8c8451a9560fb4ebe12b8a1/users/561ee8a38e3a450b9210bbcb7e9cd582/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:26.480688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bf8a7-80f8-4682-bb10-6ad9079a55b1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.481165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bf8a7-80f8-4682-bb10-6ad9079a55b1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.481587 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bf8a7-80f8-4682-bb10-6ad9079a55b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.514829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ca1bf8a7-80f8-4682-bb10-6ad9079a55b1 None None] MFA Rules not processed for user `561ee8a38e3a450b9210bbcb7e9cd582`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:26.516746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ca1bf8a7-80f8-4682-bb10-6ad9079a55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:26.526610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9184597af094b789edca5e2d32933f5', 'request_id': 'req-3615c7d9-2768-48ff-8871-c254db5d72d3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:26.537303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9184597af094b789edca5e2d32933f5', 'request_id': 'req-3615c7d9-2768-48ff-8871-c254db5d72d3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:26.543686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9184597af094b789edca5e2d32933f5', 'request_id': 'req-3615c7d9-2768-48ff-8871-c254db5d72d3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:26.557383 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] The token cache is being invalidate because project c9184597af094b789edca5e2d32933f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:26.557749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:26.558457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3615c7d9-2768-48ff-8871-c254db5d72d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:26.560247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1292/2559] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:26 2022] DELETE /identity/v3/projects/c9184597af094b789edca5e2d32933f5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:26.565428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e9a6c-e498-4a74-a773-60f94568fe60 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.565771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e9a6c-e498-4a74-a773-60f94568fe60 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.566106 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e9a6c-e498-4a74-a773-60f94568fe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.585566 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a92e9a6c-e498-4a74-a773-60f94568fe60 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:26.586753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a92e9a6c-e498-4a74-a773-60f94568fe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:26.588629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1268/2560] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:26.593068 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bf8a7-80f8-4682-bb10-6ad9079a55b1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.594392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ca1bf8a7-80f8-4682-bb10-6ad9079a55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:26.644017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:26.654643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1293/2561] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:26.659163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bf8a7-80f8-4682-bb10-6ad9079a55b1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.663798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d746-6ace-4913-ac93-d4769b9dc215 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.664048 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105ce61-e801-44a1-8cf8-7495770d546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.664181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d746-6ace-4913-ac93-d4769b9dc215 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.664336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d746-6ace-4913-ac93-d4769b9dc215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.664659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ce61-e801-44a1-8cf8-7495770d546d admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.664926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ce61-e801-44a1-8cf8-7495770d546d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.665220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ce61-e801-44a1-8cf8-7495770d546d admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.665852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105ce61-e801-44a1-8cf8-7495770d546d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.667785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105ce61-e801-44a1-8cf8-7495770d546d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.683887 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e0e4d746-6ace-4913-ac93-d4769b9dc215 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:26.685689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e0e4d746-6ace-4913-ac93-d4769b9dc215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:26.694858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1294/2562] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:26.698796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1269/2563] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:26 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:41:26.699013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d746-6ace-4913-ac93-d4769b9dc215 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.699717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105ce61-e801-44a1-8cf8-7495770d546d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.708171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d746-6ace-4913-ac93-d4769b9dc215 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.743039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:26.764515 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105ce61-e801-44a1-8cf8-7495770d546d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.767909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f1822-c128-4637-9ecf-731dd020c2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.768472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f1822-c128-4637-9ecf-731dd020c2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.768749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f1822-c128-4637-9ecf-731dd020c2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.769021 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f1822-c128-4637-9ecf-731dd020c2c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.769226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66781cf9-20ae-4bbb-b67b-06ffcdd6902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.769739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f1822-c128-4637-9ecf-731dd020c2c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:41:26.769856 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66781cf9-20ae-4bbb-b67b-06ffcdd6902b admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.770048 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f1822-c128-4637-9ecf-731dd020c2c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.770160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66781cf9-20ae-4bbb-b67b-06ffcdd6902b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.770374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66781cf9-20ae-4bbb-b67b-06ffcdd6902b admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.771010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66781cf9-20ae-4bbb-b67b-06ffcdd6902b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.771714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f1822-c128-4637-9ecf-731dd020c2c7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.772949 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66781cf9-20ae-4bbb-b67b-06ffcdd6902b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.787452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1295/2564] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:41:26.796398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f1822-c128-4637-9ecf-731dd020c2c7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.798576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1270/2565] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:26 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:26.802381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66781cf9-20ae-4bbb-b67b-06ffcdd6902b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.807551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f1822-c128-4637-9ecf-731dd020c2c7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.812925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad1a2e-cd5b-4d3d-a4d7-0617acce0950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.813112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66781cf9-20ae-4bbb-b67b-06ffcdd6902b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.813532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad1a2e-cd5b-4d3d-a4d7-0617acce0950 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.813800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad1a2e-cd5b-4d3d-a4d7-0617acce0950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.814188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad1a2e-cd5b-4d3d-a4d7-0617acce0950 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.814810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad1a2e-cd5b-4d3d-a4d7-0617acce0950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.816741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad1a2e-cd5b-4d3d-a4d7-0617acce0950 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.817869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4f181-c7d8-4596-b596-df1fb0238899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.818496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4f181-c7d8-4596-b596-df1fb0238899 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.818773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4f181-c7d8-4596-b596-df1fb0238899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.819079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4f181-c7d8-4596-b596-df1fb0238899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.819766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4f181-c7d8-4596-b596-df1fb0238899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.821297 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4f181-c7d8-4596-b596-df1fb0238899 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.835623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1271/2566] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:26.836988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4f181-c7d8-4596-b596-df1fb0238899 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.847338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1296/2567] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:26 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:26.847552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4f181-c7d8-4596-b596-df1fb0238899 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.850593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad1a2e-cd5b-4d3d-a4d7-0617acce0950 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.913329 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd181b50-8222-4b4a-9847-dc45ed4217e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.913907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd181b50-8222-4b4a-9847-dc45ed4217e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.914188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd181b50-8222-4b4a-9847-dc45ed4217e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.914473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd181b50-8222-4b4a-9847-dc45ed4217e3 admin admin] PATH_INFO: `/v3/projects/6149ff4762644621972f2dbfd313fc95/users/495e1be4609146c0adebfd45c20d5130/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.921201 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad1a2e-cd5b-4d3d-a4d7-0617acce0950 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:26.925929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a945e-bd87-4e7b-aeb7-e17c476104db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:26.926552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a945e-bd87-4e7b-aeb7-e17c476104db admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:26.926830 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a945e-bd87-4e7b-aeb7-e17c476104db admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:26.927098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a945e-bd87-4e7b-aeb7-e17c476104db admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:26.927771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a945e-bd87-4e7b-aeb7-e17c476104db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.929691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a945e-bd87-4e7b-aeb7-e17c476104db admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.931576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd181b50-8222-4b4a-9847-dc45ed4217e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6149ff4762644621972f2dbfd313fc95, user_id=495e1be4609146c0adebfd45c20d5130, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:26.934432 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd181b50-8222-4b4a-9847-dc45ed4217e3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:26.951262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1272/2568] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:26 2022] PUT /identity/v3/projects/6149ff4762644621972f2dbfd313fc95/users/495e1be4609146c0adebfd45c20d5130/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:26.953628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1297/2569] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:26 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:41:26.955227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd181b50-8222-4b4a-9847-dc45ed4217e3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.957760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a945e-bd87-4e7b-aeb7-e17c476104db admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:26.969360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a945e-bd87-4e7b-aeb7-e17c476104db admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.022218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd181b50-8222-4b4a-9847-dc45ed4217e3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.027084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e0778-1016-4bb5-9ae8-174d280a8fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.027697 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:27.027848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0778-1016-4bb5-9ae8-174d280a8fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.028001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0778-1016-4bb5-9ae8-174d280a8fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.028392 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0778-1016-4bb5-9ae8-174d280a8fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.029173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e0778-1016-4bb5-9ae8-174d280a8fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.031405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e0778-1016-4bb5-9ae8-174d280a8fa0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.036859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0714d7-2868-4f5c-a9c2-1ffc5487d05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.037901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0714d7-2868-4f5c-a9c2-1ffc5487d05f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.038418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0714d7-2868-4f5c-a9c2-1ffc5487d05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.038896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0714d7-2868-4f5c-a9c2-1ffc5487d05f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.039600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0714d7-2868-4f5c-a9c2-1ffc5487d05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.041220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0714d7-2868-4f5c-a9c2-1ffc5487d05f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.042706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1273/2570] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:27.046916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e0778-1016-4bb5-9ae8-174d280a8fa0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.055549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1298/2571] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:27.056791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e0778-1016-4bb5-9ae8-174d280a8fa0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.059224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0714d7-2868-4f5c-a9c2-1ffc5487d05f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.062576 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a0a80-4a3b-49d9-938c-da6b02dcaa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.063238 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a0a80-4a3b-49d9-938c-da6b02dcaa8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.063545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a0a80-4a3b-49d9-938c-da6b02dcaa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.063812 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a0a80-4a3b-49d9-938c-da6b02dcaa8b admin admin] PATH_INFO: `/v3/projects/6149ff4762644621972f2dbfd313fc95/users/495e1be4609146c0adebfd45c20d5130/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.065706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a0a80-4a3b-49d9-938c-da6b02dcaa8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6149ff4762644621972f2dbfd313fc95, user_id=495e1be4609146c0adebfd45c20d5130, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.068391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a0a80-4a3b-49d9-938c-da6b02dcaa8b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.069061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0714d7-2868-4f5c-a9c2-1ffc5487d05f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.073803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140163b-b551-40a4-b904-b5cf20a104d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.074412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140163b-b551-40a4-b904-b5cf20a104d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.074693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140163b-b551-40a4-b904-b5cf20a104d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.075506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140163b-b551-40a4-b904-b5cf20a104d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.075767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140163b-b551-40a4-b904-b5cf20a104d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.077353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140163b-b551-40a4-b904-b5cf20a104d3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.081494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1274/2572] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:27 2022] PUT /identity/v3/projects/6149ff4762644621972f2dbfd313fc95/users/495e1be4609146c0adebfd45c20d5130/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:27.090833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1299/2573] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:27.093173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31d15-2521-43a8-9d28-98e6f450c78d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.093601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31d15-2521-43a8-9d28-98e6f450c78d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.093773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31d15-2521-43a8-9d28-98e6f450c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.095186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140163b-b551-40a4-b904-b5cf20a104d3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.106585 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140163b-b551-40a4-b904-b5cf20a104d3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.124162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-72b31d15-2521-43a8-9d28-98e6f450c78d None None] MFA Rules not processed for user `495e1be4609146c0adebfd45c20d5130`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:27.125508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-72b31d15-2521-43a8-9d28-98e6f450c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:27.139917 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:27.188369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd46c55-97c9-4bd8-8efb-5bc498ea7835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.189095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd46c55-97c9-4bd8-8efb-5bc498ea7835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.189371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd46c55-97c9-4bd8-8efb-5bc498ea7835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.189934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd46c55-97c9-4bd8-8efb-5bc498ea7835 admin admin] PATH_INFO: `/v3/projects/372729e964f04711acb144092ca2920b/users/f2347af4ae18469189e7234a81acf293/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.207362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd46c55-97c9-4bd8-8efb-5bc498ea7835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=372729e964f04711acb144092ca2920b, user_id=f2347af4ae18469189e7234a81acf293, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.210429 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd46c55-97c9-4bd8-8efb-5bc498ea7835 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.218045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1275/2574] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:27.232044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b31d15-2521-43a8-9d28-98e6f450c78d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.232910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1300/2575] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:27 2022] PUT /identity/v3/projects/372729e964f04711acb144092ca2920b/users/f2347af4ae18469189e7234a81acf293/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:27.233671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-72b31d15-2521-43a8-9d28-98e6f450c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:27.242001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fdb99-3e28-4fbb-acc7-4a5a57cf222e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.242207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fdb99-3e28-4fbb-acc7-4a5a57cf222e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.242481 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fdb99-3e28-4fbb-acc7-4a5a57cf222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.277254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dc6fdb99-3e28-4fbb-acc7-4a5a57cf222e None None] MFA Rules not processed for user `f2347af4ae18469189e7234a81acf293`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:27.279088 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dc6fdb99-3e28-4fbb-acc7-4a5a57cf222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:27.321551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b31d15-2521-43a8-9d28-98e6f450c78d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.371060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1301/2576] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:27.376327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fdb99-3e28-4fbb-acc7-4a5a57cf222e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.387001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6119-5bdb-4987-944b-dba0a655bac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.387749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6119-5bdb-4987-944b-dba0a655bac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.387941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6119-5bdb-4987-944b-dba0a655bac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.388210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6119-5bdb-4987-944b-dba0a655bac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.438326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:27.450399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fdb99-3e28-4fbb-acc7-4a5a57cf222e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.455004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6119-5bdb-4987-944b-dba0a655bac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.455167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e7262-72ea-42b3-860e-cd216fb968c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.455720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e7262-72ea-42b3-860e-cd216fb968c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.455997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e7262-72ea-42b3-860e-cd216fb968c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.456270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e7262-72ea-42b3-860e-cd216fb968c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.456501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6119-5bdb-4987-944b-dba0a655bac4 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.456901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e7262-72ea-42b3-860e-cd216fb968c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.458889 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e7262-72ea-42b3-860e-cd216fb968c6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.466497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1276/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:27.494277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1302/2578] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:27 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:41:27.496330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6119-5bdb-4987-944b-dba0a655bac4 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.515481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6119-5bdb-4987-944b-dba0a655bac4 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.531711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:27.580819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771afd7-4244-4422-876d-c0a038c0f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.581518 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771afd7-4244-4422-876d-c0a038c0f07f admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.581792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771afd7-4244-4422-876d-c0a038c0f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.582152 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771afd7-4244-4422-876d-c0a038c0f07f admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.582676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771afd7-4244-4422-876d-c0a038c0f07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.585273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771afd7-4244-4422-876d-c0a038c0f07f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.613113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1277/2579] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:27 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:41:27.614657 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e7262-72ea-42b3-860e-cd216fb968c6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.629883 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e7262-72ea-42b3-860e-cd216fb968c6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.635479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb59c7-17cb-4e1e-9bcf-6587bc354615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.636157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb59c7-17cb-4e1e-9bcf-6587bc354615 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.636510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb59c7-17cb-4e1e-9bcf-6587bc354615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.636864 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb59c7-17cb-4e1e-9bcf-6587bc354615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.637663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb59c7-17cb-4e1e-9bcf-6587bc354615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.639805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb59c7-17cb-4e1e-9bcf-6587bc354615 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.658537 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1303/2580] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:27.659773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771afd7-4244-4422-876d-c0a038c0f07f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.673408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771afd7-4244-4422-876d-c0a038c0f07f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.678537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b155a33-fba4-4976-ac40-c24e3425fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.679194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b155a33-fba4-4976-ac40-c24e3425fdbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.679499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b155a33-fba4-4976-ac40-c24e3425fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.679768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b155a33-fba4-4976-ac40-c24e3425fdbb admin admin] PATH_INFO: `/v3/projects/5137d3dcaece414991c5c1715e9bd805/users/c1c124113a6845afbdba1562e9189b27/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.695548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b155a33-fba4-4976-ac40-c24e3425fdbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5137d3dcaece414991c5c1715e9bd805, user_id=c1c124113a6845afbdba1562e9189b27, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.698651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b155a33-fba4-4976-ac40-c24e3425fdbb admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.704927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e11884-1eb6-4497-9f1f-a2410b022322 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.705305 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e11884-1eb6-4497-9f1f-a2410b022322 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.705524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e11884-1eb6-4497-9f1f-a2410b022322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.715476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1278/2581] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:27 2022] PUT /identity/v3/projects/5137d3dcaece414991c5c1715e9bd805/users/c1c124113a6845afbdba1562e9189b27/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:27.719419 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b155a33-fba4-4976-ac40-c24e3425fdbb admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.731709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-80e11884-1eb6-4497-9f1f-a2410b022322 None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:27.733103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-80e11884-1eb6-4497-9f1f-a2410b022322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:27.798674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b155a33-fba4-4976-ac40-c24e3425fdbb admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.803076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1304/2582] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:27.804795 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2e38b-7a06-4654-9ba1-9e1482d9a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.805491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2e38b-7a06-4654-9ba1-9e1482d9a064 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.805831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2e38b-7a06-4654-9ba1-9e1482d9a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.806182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2e38b-7a06-4654-9ba1-9e1482d9a064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.806976 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2e38b-7a06-4654-9ba1-9e1482d9a064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.808888 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2e38b-7a06-4654-9ba1-9e1482d9a064 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.816018 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e11884-1eb6-4497-9f1f-a2410b022322 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.817413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-80e11884-1eb6-4497-9f1f-a2410b022322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:27.829775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1279/2583] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:27.830983 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2e38b-7a06-4654-9ba1-9e1482d9a064 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:27.844844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2e38b-7a06-4654-9ba1-9e1482d9a064 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.849736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742dab8-1992-4bc9-9c30-3f5afdec3a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.850471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742dab8-1992-4bc9-9c30-3f5afdec3a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.850820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742dab8-1992-4bc9-9c30-3f5afdec3a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.851386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742dab8-1992-4bc9-9c30-3f5afdec3a49 admin admin] PATH_INFO: `/v3/projects/5137d3dcaece414991c5c1715e9bd805/users/c1c124113a6845afbdba1562e9189b27/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.853245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742dab8-1992-4bc9-9c30-3f5afdec3a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5137d3dcaece414991c5c1715e9bd805, user_id=c1c124113a6845afbdba1562e9189b27, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:27.855825 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742dab8-1992-4bc9-9c30-3f5afdec3a49 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:27.872835 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1280/2584] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:27 2022] PUT /identity/v3/projects/5137d3dcaece414991c5c1715e9bd805/users/c1c124113a6845afbdba1562e9189b27/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:27.882986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926eceb-dc9e-41b2-9a76-8d3f82856ff7 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.883399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926eceb-dc9e-41b2-9a76-8d3f82856ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.883671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926eceb-dc9e-41b2-9a76-8d3f82856ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.898265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e11884-1eb6-4497-9f1f-a2410b022322 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:27.914253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f926eceb-dc9e-41b2-9a76-8d3f82856ff7 None None] MFA Rules not processed for user `c1c124113a6845afbdba1562e9189b27`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:27.915589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f926eceb-dc9e-41b2-9a76-8d3f82856ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:27.973225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7013a60-e251-41da-a016-f95305e775eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:27.973863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7013a60-e251-41da-a016-f95305e775eb service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:27.974138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7013a60-e251-41da-a016-f95305e775eb service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:27.974405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7013a60-e251-41da-a016-f95305e775eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:27.977462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:27.990544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:28.004167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1281/2585] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:28.020228 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926eceb-dc9e-41b2-9a76-8d3f82856ff7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:28.049272 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7013a60-e251-41da-a016-f95305e775eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:28.050972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7013a60-e251-41da-a016-f95305e775eb service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:28.061679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1305/2586] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:41:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 06 04:41:28.086611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926eceb-dc9e-41b2-9a76-8d3f82856ff7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:28.090617 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b0306-8d2d-4c29-8702-d3b64a2d6fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:28.091499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b0306-8d2d-4c29-8702-d3b64a2d6fac service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:28.091818 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b0306-8d2d-4c29-8702-d3b64a2d6fac service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:28.092085 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b0306-8d2d-4c29-8702-d3b64a2d6fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:28.103416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b0306-8d2d-4c29-8702-d3b64a2d6fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:28.105185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b0306-8d2d-4c29-8702-d3b64a2d6fac service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:28.121201 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1282/2587] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:28.207442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7013a60-e251-41da-a016-f95305e775eb service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:28.358703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7013a60-e251-41da-a016-f95305e775eb service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:28.371034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:28.372559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:28.373364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:28.374059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] PATH_INFO: `/v3/users/f2347af4ae18469189e7234a81acf293` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:28.376401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2347af4ae18469189e7234a81acf293)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:28.378644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:28.461834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2347af4ae18469189e7234a81acf293'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:28.492341 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2347af4ae18469189e7234a81acf293'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:28.515736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2347af4ae18469189e7234a81acf293'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:28.516497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2347af4ae18469189e7234a81acf293'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:28.548204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2347af4ae18469189e7234a81acf293'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:28.555997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1306/2588] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:28 2022] DELETE /identity/v3/users/f2347af4ae18469189e7234a81acf293 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:28.560494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e8c6a-47b7-4538-bddc-c70b2ddfba4c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:28.560821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e8c6a-47b7-4538-bddc-c70b2ddfba4c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:28.561052 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e8c6a-47b7-4538-bddc-c70b2ddfba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:28.605495 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-853e8c6a-47b7-4538-bddc-c70b2ddfba4c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:28.606971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-853e8c6a-47b7-4538-bddc-c70b2ddfba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:28.734939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1283/2589] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:28.744940 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:28.746730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:28.849150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:28.886490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af86ca-e441-4c5f-aa03-7eca5e982808 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:28.890711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f9532-8250-40a7-9973-80d332c3274f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:28.891385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f9532-8250-40a7-9973-80d332c3274f service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:28.891655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f9532-8250-40a7-9973-80d332c3274f service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:28.891937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f9532-8250-40a7-9973-80d332c3274f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:28.905514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f9532-8250-40a7-9973-80d332c3274f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:28.907622 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f9532-8250-40a7-9973-80d332c3274f service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:28.932007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1307/2590] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:29.393528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e8c6a-47b7-4538-bddc-c70b2ddfba4c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:29.395135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-853e8c6a-47b7-4538-bddc-c70b2ddfba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:29.398542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f9532-8250-40a7-9973-80d332c3274f service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:29.401001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-303f9532-8250-40a7-9973-80d332c3274f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:29.433917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f9532-8250-40a7-9973-80d332c3274f service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:29.441974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e8c6a-47b7-4538-bddc-c70b2ddfba4c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:29.448425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:29.449094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:29.449501 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:29.449591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] PATH_INFO: `/v3/users/561ee8a38e3a450b9210bbcb7e9cd582` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:29.460706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:29.461358 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:29.461505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] RBAC: Authorizing `identity:delete_user(user_id=561ee8a38e3a450b9210bbcb7e9cd582)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:29.461692 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:29.461910 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] PATH_INFO: `/v3/projects/372729e964f04711acb144092ca2920b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:29.463158 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=372729e964f04711acb144092ca2920b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:29.463441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:29.465281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:29.528164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561ee8a38e3a450b9210bbcb7e9cd582'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.542551 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561ee8a38e3a450b9210bbcb7e9cd582'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.551156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372729e964f04711acb144092ca2920b', 'request_id': 'req-26ee823c-14d5-4f3d-a58e-5b51f737f7be'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.568290 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561ee8a38e3a450b9210bbcb7e9cd582'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.569082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561ee8a38e3a450b9210bbcb7e9cd582'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.570786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372729e964f04711acb144092ca2920b', 'request_id': 'req-26ee823c-14d5-4f3d-a58e-5b51f737f7be'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.577741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b5513094-8ea1-4a3e-9a71-f7fff4f1d22c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561ee8a38e3a450b9210bbcb7e9cd582'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.578420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372729e964f04711acb144092ca2920b', 'request_id': 'req-26ee823c-14d5-4f3d-a58e-5b51f737f7be'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.585936 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1308/2591] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:29 2022] DELETE /identity/v3/users/561ee8a38e3a450b9210bbcb7e9cd582 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:29.590404 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8753a-988d-467c-bb71-d74b0a63c11c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:29.590815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8753a-988d-467c-bb71-d74b0a63c11c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:29.591153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8753a-988d-467c-bb71-d74b0a63c11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:29.592233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] The token cache is being invalidate because project 372729e964f04711acb144092ca2920b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:29.592529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.593179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.594856 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1284/2592] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:29 2022] DELETE /identity/v3/projects/372729e964f04711acb144092ca2920b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:29.598438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:29.600032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:29.616767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ebe8753a-988d-467c-bb71-d74b0a63c11c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:29.618213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ebe8753a-988d-467c-bb71-d74b0a63c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:29.620986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:29.674213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee823c-14d5-4f3d-a58e-5b51f737f7be admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:29.690828 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1309/2593] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:29.700807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8753a-988d-467c-bb71-d74b0a63c11c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:29.703244 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ebe8753a-988d-467c-bb71-d74b0a63c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:29.744781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:29.745429 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:29.745701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:29.745966 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] PATH_INFO: `/v3/users/c1c124113a6845afbdba1562e9189b27` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:29.747434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c124113a6845afbdba1562e9189b27)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:29.749478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:29.813057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c124113a6845afbdba1562e9189b27'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.813849 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c124113a6845afbdba1562e9189b27'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.826105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c124113a6845afbdba1562e9189b27'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.842038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c124113a6845afbdba1562e9189b27'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.846516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8753a-988d-467c-bb71-d74b0a63c11c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:29.851287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb9983-1bb5-4e25-bbe3-2b2f48468021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:29.852726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb9983-1bb5-4e25-bbe3-2b2f48468021 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:29.853253 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb9983-1bb5-4e25-bbe3-2b2f48468021 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:29.853759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb9983-1bb5-4e25-bbe3-2b2f48468021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:29.856644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bfdb9983-1bb5-4e25-bbe3-2b2f48468021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:29.863214 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c124113a6845afbdba1562e9189b27'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:29.869445 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:29.870474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1285/2594] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:29 2022] DELETE /identity/v3/users/c1c124113a6845afbdba1562e9189b27 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:29.874608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb9983-1bb5-4e25-bbe3-2b2f48468021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:29.876207 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb9983-1bb5-4e25-bbe3-2b2f48468021 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:29.904123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1310/2595] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:30.332456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:30.334003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:30.338665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb9983-1bb5-4e25-bbe3-2b2f48468021 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:30.340299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bfdb9983-1bb5-4e25-bbe3-2b2f48468021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:30.357667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb9983-1bb5-4e25-bbe3-2b2f48468021 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:30.393952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:30.419688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27b31f-fe25-4390-bdca-d1a330c4310a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:30.442832 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:30.444210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:30.445423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:30.445864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] PATH_INFO: `/v3/projects/5137d3dcaece414991c5c1715e9bd805` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:30.448319 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5137d3dcaece414991c5c1715e9bd805)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:30.451751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:30.487952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:30.490047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:30.490589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:30.491972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] PATH_INFO: `/v3/projects/1a2c2406e8c8451a9560fb4ebe12b8a1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:30.496125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2c2406e8c8451a9560fb4ebe12b8a1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:30.498265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:30.525944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5137d3dcaece414991c5c1715e9bd805', 'request_id': 'req-f3e20ab6-9aab-4ed8-a461-b5fd24459553'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.536610 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5137d3dcaece414991c5c1715e9bd805', 'request_id': 'req-f3e20ab6-9aab-4ed8-a461-b5fd24459553'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.547241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5137d3dcaece414991c5c1715e9bd805', 'request_id': 'req-f3e20ab6-9aab-4ed8-a461-b5fd24459553'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.554102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2c2406e8c8451a9560fb4ebe12b8a1', 'request_id': 'req-ff7af5d8-507c-448e-934a-d64881d69902'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.565723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2c2406e8c8451a9560fb4ebe12b8a1', 'request_id': 'req-ff7af5d8-507c-448e-934a-d64881d69902'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.569451 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] The token cache is being invalidate because project 5137d3dcaece414991c5c1715e9bd805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:30.570232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.571080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f3e20ab6-9aab-4ed8-a461-b5fd24459553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.573841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1286/2596] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:30 2022] DELETE /identity/v3/projects/5137d3dcaece414991c5c1715e9bd805 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:30.574204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2c2406e8c8451a9560fb4ebe12b8a1', 'request_id': 'req-ff7af5d8-507c-448e-934a-d64881d69902'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.580511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1245-ec08-4b17-8689-594f05e38e96 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:30.580946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1245-ec08-4b17-8689-594f05e38e96 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:30.581226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1245-ec08-4b17-8689-594f05e38e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:30.587559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] The token cache is being invalidate because project 1a2c2406e8c8451a9560fb4ebe12b8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:30.587925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.588821 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.590812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1311/2597] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:30 2022] DELETE /identity/v3/projects/1a2c2406e8c8451a9560fb4ebe12b8a1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:30.595397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:30.597066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:30.612866 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ec0e1245-ec08-4b17-8689-594f05e38e96 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:30.614386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ec0e1245-ec08-4b17-8689-594f05e38e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:30.689717 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7af5d8-507c-448e-934a-d64881d69902 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:30.698578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1287/2598] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:30.700746 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713c3b-660b-4216-9b01-022a0d657417 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:30.701496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713c3b-660b-4216-9b01-022a0d657417 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:30.702032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713c3b-660b-4216-9b01-022a0d657417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:30.708099 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:30.708771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:30.709067 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:30.709323 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] PATH_INFO: `/v3/users/495e1be4609146c0adebfd45c20d5130` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:30.710765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] RBAC: Authorizing `identity:delete_user(user_id=495e1be4609146c0adebfd45c20d5130)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:30.712754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:30.728282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d8713c3b-660b-4216-9b01-022a0d657417 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:30.729636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d8713c3b-660b-4216-9b01-022a0d657417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:30.738426 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1288/2599] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:30.744407 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8713c3b-660b-4216-9b01-022a0d657417 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:30.756823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8713c3b-660b-4216-9b01-022a0d657417 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:30.764273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594102-d987-4474-a8e5-01acce593550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:30.764962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594102-d987-4474-a8e5-01acce593550 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:30.765395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594102-d987-4474-a8e5-01acce593550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:30.765545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594102-d987-4474-a8e5-01acce593550 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:30.766210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594102-d987-4474-a8e5-01acce593550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:41:30.766538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594102-d987-4474-a8e5-01acce593550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:30.767938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:30.768240 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594102-d987-4474-a8e5-01acce593550 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:30.784718 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1289/2600] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:41:30.785740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594102-d987-4474-a8e5-01acce593550 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:30.791138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495e1be4609146c0adebfd45c20d5130'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.799169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594102-d987-4474-a8e5-01acce593550 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:30.800362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495e1be4609146c0adebfd45c20d5130'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.804925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90f534-40fe-40d5-aa83-9f213a35be65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:30.805523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90f534-40fe-40d5-aa83-9f213a35be65 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:30.805803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90f534-40fe-40d5-aa83-9f213a35be65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:30.806066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90f534-40fe-40d5-aa83-9f213a35be65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:30.806689 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90f534-40fe-40d5-aa83-9f213a35be65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:30.808606 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90f534-40fe-40d5-aa83-9f213a35be65 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:30.819584 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495e1be4609146c0adebfd45c20d5130'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.820450 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495e1be4609146c0adebfd45c20d5130'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.832954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495e1be4609146c0adebfd45c20d5130'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:30.846826 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1312/2601] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:30 2022] DELETE /identity/v3/users/495e1be4609146c0adebfd45c20d5130 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:30.856397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1290/2602] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:30 2022] POST /identity/v3/projects => generated 361 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:30.861782 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:30.864398 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:30.977937 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88775d3e-55c3-410d-9f41-9fbd61dd310c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:31.076761 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502e5b2-8e91-402b-98a8-d6eac8fe8800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:31.078372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e5b2-8e91-402b-98a8-d6eac8fe8800 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.079611 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e5b2-8e91-402b-98a8-d6eac8fe8800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.080298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e5b2-8e91-402b-98a8-d6eac8fe8800 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.081276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502e5b2-8e91-402b-98a8-d6eac8fe8800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:31.087436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502e5b2-8e91-402b-98a8-d6eac8fe8800 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:31.130665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1313/2603] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:30 2022] POST /identity/v3/users => generated 281 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:31.134825 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90f534-40fe-40d5-aa83-9f213a35be65 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:31.151696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90f534-40fe-40d5-aa83-9f213a35be65 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:31.171552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3221f9-182b-4bb4-9595-bf6874705696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:31.172349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3221f9-182b-4bb4-9595-bf6874705696 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.172629 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3221f9-182b-4bb4-9595-bf6874705696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.172901 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3221f9-182b-4bb4-9595-bf6874705696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.173596 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3221f9-182b-4bb4-9595-bf6874705696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:31.175220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3221f9-182b-4bb4-9595-bf6874705696 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:31.191945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1291/2604] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:31.193729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502e5b2-8e91-402b-98a8-d6eac8fe8800 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:31.227381 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502e5b2-8e91-402b-98a8-d6eac8fe8800 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:31.233421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100dcf1-e47c-40cc-a8c0-8f689a24b5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:31.234317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100dcf1-e47c-40cc-a8c0-8f689a24b5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.234778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100dcf1-e47c-40cc-a8c0-8f689a24b5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.235196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100dcf1-e47c-40cc-a8c0-8f689a24b5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.236401 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100dcf1-e47c-40cc-a8c0-8f689a24b5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:31.238231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100dcf1-e47c-40cc-a8c0-8f689a24b5e1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:31.251861 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1314/2605] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:31.256421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3221f9-182b-4bb4-9595-bf6874705696 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:31.273546 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3221f9-182b-4bb4-9595-bf6874705696 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:31.282284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100dcf1-e47c-40cc-a8c0-8f689a24b5e1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:31.284033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2100dcf1-e47c-40cc-a8c0-8f689a24b5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:31.284283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234667a-d790-43ed-9af0-2b378f3e6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:31.284971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234667a-d790-43ed-9af0-2b378f3e6cab admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.285252 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234667a-d790-43ed-9af0-2b378f3e6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.285508 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234667a-d790-43ed-9af0-2b378f3e6cab admin admin] PATH_INFO: `/v3/projects/123e170bb91141c283e0739f20d1d350/users/54a91351369a48a38bd510b998c120da/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.322308 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100dcf1-e47c-40cc-a8c0-8f689a24b5e1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:31.323222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234667a-d790-43ed-9af0-2b378f3e6cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=123e170bb91141c283e0739f20d1d350, user_id=54a91351369a48a38bd510b998c120da, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:31.327753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:31.328310 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.328479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234667a-d790-43ed-9af0-2b378f3e6cab admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:31.328591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.328850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] PATH_INFO: `/v3/projects/6149ff4762644621972f2dbfd313fc95` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.330085 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6149ff4762644621972f2dbfd313fc95)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:31.332560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:31.351289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:31.364793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1292/2606] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:31 2022] PUT /identity/v3/projects/123e170bb91141c283e0739f20d1d350/users/54a91351369a48a38bd510b998c120da/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:31.375798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070db53-6816-4c6e-aef3-a0d30ae1a24f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.376374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070db53-6816-4c6e-aef3-a0d30ae1a24f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.376757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070db53-6816-4c6e-aef3-a0d30ae1a24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.377704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:31.411012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6149ff4762644621972f2dbfd313fc95', 'request_id': 'req-e2d1a919-7556-4ce9-9383-cba94fda4b05'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:31.420375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6070db53-6816-4c6e-aef3-a0d30ae1a24f None None] MFA Rules not processed for user `54a91351369a48a38bd510b998c120da`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:31.421710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6070db53-6816-4c6e-aef3-a0d30ae1a24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:31.434671 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6149ff4762644621972f2dbfd313fc95', 'request_id': 'req-e2d1a919-7556-4ce9-9383-cba94fda4b05'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:31.442368 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6149ff4762644621972f2dbfd313fc95', 'request_id': 'req-e2d1a919-7556-4ce9-9383-cba94fda4b05'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:31.464475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] The token cache is being invalidate because project 6149ff4762644621972f2dbfd313fc95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:31.464983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:31.465842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e2d1a919-7556-4ce9-9383-cba94fda4b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:31.468110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1315/2607] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:31 2022] DELETE /identity/v3/projects/6149ff4762644621972f2dbfd313fc95 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:31.473143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13575f1a-5c76-4395-a942-7ddcbe181f52 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.473624 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13575f1a-5c76-4395-a942-7ddcbe181f52 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.474071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13575f1a-5c76-4395-a942-7ddcbe181f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.508640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-13575f1a-5c76-4395-a942-7ddcbe181f52 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:31.509999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-13575f1a-5c76-4395-a942-7ddcbe181f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:31.524761 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1293/2608] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:31.562830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070db53-6816-4c6e-aef3-a0d30ae1a24f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:31.564459 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6070db53-6816-4c6e-aef3-a0d30ae1a24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:31.619789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1316/2609] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:31.624213 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed95f0b-486f-445b-886a-d04293fba46b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.625204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed95f0b-486f-445b-886a-d04293fba46b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.625479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed95f0b-486f-445b-886a-d04293fba46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.653446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aed95f0b-486f-445b-886a-d04293fba46b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:31.654788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aed95f0b-486f-445b-886a-d04293fba46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:31.662934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1317/2610] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:31.664586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070db53-6816-4c6e-aef3-a0d30ae1a24f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:31.667646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed95f0b-486f-445b-886a-d04293fba46b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:31.671206 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e304f-df84-4144-989e-3e291909a95b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:31.672058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e304f-df84-4144-989e-3e291909a95b service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.672482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e304f-df84-4144-989e-3e291909a95b service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.672923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e304f-df84-4144-989e-3e291909a95b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.678637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed95f0b-486f-445b-886a-d04293fba46b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:31.683497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d8830-608f-45e9-b799-e42b8dc39b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:31.684384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d8830-608f-45e9-b799-e42b8dc39b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.684891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d8830-608f-45e9-b799-e42b8dc39b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.685286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d8830-608f-45e9-b799-e42b8dc39b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.686078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d8830-608f-45e9-b799-e42b8dc39b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:41:31.686532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d8830-608f-45e9-b799-e42b8dc39b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:31.688188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d8830-608f-45e9-b799-e42b8dc39b3b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:31.697743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e304f-df84-4144-989e-3e291909a95b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:31.699382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e304f-df84-4144-989e-3e291909a95b service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:31.711260 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1294/2611] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:31.718178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1318/2612] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:41:31.719219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e304f-df84-4144-989e-3e291909a95b service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:31.726824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d8830-608f-45e9-b799-e42b8dc39b3b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:31.728609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1d5d8830-608f-45e9-b799-e42b8dc39b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:31.736766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e304f-df84-4144-989e-3e291909a95b service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:31.742427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834e212-a78a-49a2-a920-d822cd34fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:31.743066 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834e212-a78a-49a2-a920-d822cd34fcd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.743363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834e212-a78a-49a2-a920-d822cd34fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.743662 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834e212-a78a-49a2-a920-d822cd34fcd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.744305 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834e212-a78a-49a2-a920-d822cd34fcd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:31.746204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834e212-a78a-49a2-a920-d822cd34fcd7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:31.746625 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d8830-608f-45e9-b799-e42b8dc39b3b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:31.757337 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:31.758244 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.758518 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.758784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] PATH_INFO: `/v3/users/54a91351369a48a38bd510b998c120da` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.759980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a91351369a48a38bd510b998c120da)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:31.761901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:31.779405 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1295/2613] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:31 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:41:31.783695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834e212-a78a-49a2-a920-d822cd34fcd7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:31.827376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a91351369a48a38bd510b998c120da'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:31.836727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a91351369a48a38bd510b998c120da'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:31.855153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a91351369a48a38bd510b998c120da'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:31.856505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a91351369a48a38bd510b998c120da'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:31.869972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-814f3844-4718-43b3-b39f-dc4e7e63ed5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a91351369a48a38bd510b998c120da'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:31.874520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834e212-a78a-49a2-a920-d822cd34fcd7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:31.878410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1319/2614] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:31 2022] DELETE /identity/v3/users/54a91351369a48a38bd510b998c120da => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:31.880130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabe50e-2644-4892-934b-2366a325e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:31.881064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabe50e-2644-4892-934b-2366a325e57b admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.881557 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabe50e-2644-4892-934b-2366a325e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.881880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabe50e-2644-4892-934b-2366a325e57b admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.882588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabe50e-2644-4892-934b-2366a325e57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:31.882993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b9c17-b50b-44a3-a2da-4f4dff9cc5fc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:31.883284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b9c17-b50b-44a3-a2da-4f4dff9cc5fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:31.884082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b9c17-b50b-44a3-a2da-4f4dff9cc5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:31.884753 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabe50e-2644-4892-934b-2366a325e57b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:31.900132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:31.906092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:31.916693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1296/2615] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:31 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:31.917725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d29b9c17-b50b-44a3-a2da-4f4dff9cc5fc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:31.919005 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d29b9c17-b50b-44a3-a2da-4f4dff9cc5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:31.920269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabe50e-2644-4892-934b-2366a325e57b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:31.921972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0cabe50e-2644-4892-934b-2366a325e57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:31.934523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabe50e-2644-4892-934b-2366a325e57b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.012916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1320/2616] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:32.013883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5b3d3-25ff-40e7-8876-7940b15128f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:32.014507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5b3d3-25ff-40e7-8876-7940b15128f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.014778 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5b3d3-25ff-40e7-8876-7940b15128f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.015040 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5b3d3-25ff-40e7-8876-7940b15128f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.015751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5b3d3-25ff-40e7-8876-7940b15128f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:32.017455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5b3d3-25ff-40e7-8876-7940b15128f9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:32.022759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b9c17-b50b-44a3-a2da-4f4dff9cc5fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:32.024593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d29b9c17-b50b-44a3-a2da-4f4dff9cc5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:32.031273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1297/2617] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:32.032496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5b3d3-25ff-40e7-8876-7940b15128f9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:32.042441 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5b3d3-25ff-40e7-8876-7940b15128f9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.049775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064e428-d4cd-460f-93ca-b8357666deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:32.050698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064e428-d4cd-460f-93ca-b8357666deb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.050968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064e428-d4cd-460f-93ca-b8357666deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.051234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064e428-d4cd-460f-93ca-b8357666deb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.051928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064e428-d4cd-460f-93ca-b8357666deb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:32.053551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064e428-d4cd-460f-93ca-b8357666deb6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:32.071863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1298/2618] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:32.078277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064e428-d4cd-460f-93ca-b8357666deb6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:32.102097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064e428-d4cd-460f-93ca-b8357666deb6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.107194 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe408ba-b77b-43b3-9ed5-7e276285d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:32.107927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe408ba-b77b-43b3-9ed5-7e276285d7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.108373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe408ba-b77b-43b3-9ed5-7e276285d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.108701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe408ba-b77b-43b3-9ed5-7e276285d7b5 admin admin] PATH_INFO: `/v3/projects/4b1cd83889cf48c79d39fe17c31e376c/users/45a8f24b87ee4ec6a2afd26d46e818e8/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.112093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b9c17-b50b-44a3-a2da-4f4dff9cc5fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.115712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60396aa6-96fb-461d-a9cc-d1831882c596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:32.116318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60396aa6-96fb-461d-a9cc-d1831882c596 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.116592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60396aa6-96fb-461d-a9cc-d1831882c596 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.116855 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60396aa6-96fb-461d-a9cc-d1831882c596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.126467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe408ba-b77b-43b3-9ed5-7e276285d7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1cd83889cf48c79d39fe17c31e376c, user_id=45a8f24b87ee4ec6a2afd26d46e818e8, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:32.129014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60396aa6-96fb-461d-a9cc-d1831882c596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:32.129537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe408ba-b77b-43b3-9ed5-7e276285d7b5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:32.130905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60396aa6-96fb-461d-a9cc-d1831882c596 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:32.146654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1321/2619] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:32.151222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1299/2620] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:32 2022] PUT /identity/v3/projects/4b1cd83889cf48c79d39fe17c31e376c/users/45a8f24b87ee4ec6a2afd26d46e818e8/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:32.162032 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92d721-510b-4656-b9f5-91865863d10a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.162373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92d721-510b-4656-b9f5-91865863d10a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.162722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92d721-510b-4656-b9f5-91865863d10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.196722 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bc92d721-510b-4656-b9f5-91865863d10a None None] MFA Rules not processed for user `45a8f24b87ee4ec6a2afd26d46e818e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:32.197955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bc92d721-510b-4656-b9f5-91865863d10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:32.296267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1322/2621] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:32.299110 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe408ba-b77b-43b3-9ed5-7e276285d7b5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:32.422163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe408ba-b77b-43b3-9ed5-7e276285d7b5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.427258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48622f-b71e-4da7-b85c-e4b4fb42c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:32.427959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48622f-b71e-4da7-b85c-e4b4fb42c27a admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.428231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48622f-b71e-4da7-b85c-e4b4fb42c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.428495 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48622f-b71e-4da7-b85c-e4b4fb42c27a admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.429143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48622f-b71e-4da7-b85c-e4b4fb42c27a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:32.431022 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48622f-b71e-4da7-b85c-e4b4fb42c27a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:32.480126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1300/2622] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:32 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:32.484628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92d721-510b-4656-b9f5-91865863d10a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:32.497152 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92d721-510b-4656-b9f5-91865863d10a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.557329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:32.594437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0709f-5345-44d5-9a7c-9ed4af43fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:32.595177 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0709f-5345-44d5-9a7c-9ed4af43fc3b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.595505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0709f-5345-44d5-9a7c-9ed4af43fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.595778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0709f-5345-44d5-9a7c-9ed4af43fc3b admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.596673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0709f-5345-44d5-9a7c-9ed4af43fc3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:32.598880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0709f-5345-44d5-9a7c-9ed4af43fc3b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:32.633506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1323/2623] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:32 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:32.637745 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48622f-b71e-4da7-b85c-e4b4fb42c27a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:32.650654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48622f-b71e-4da7-b85c-e4b4fb42c27a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.650871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0709f-5345-44d5-9a7c-9ed4af43fc3b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:32.667935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb308a-d04f-4a9b-9773-a0695f660813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:32.668792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb308a-d04f-4a9b-9773-a0695f660813 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.669179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb308a-d04f-4a9b-9773-a0695f660813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.669575 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb308a-d04f-4a9b-9773-a0695f660813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.670728 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb308a-d04f-4a9b-9773-a0695f660813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:32.679366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb308a-d04f-4a9b-9773-a0695f660813 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:32.679604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-efe0709f-5345-44d5-9a7c-9ed4af43fc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:32.693198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1301/2624] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:32.694246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb308a-d04f-4a9b-9773-a0695f660813 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:32.706463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0709f-5345-44d5-9a7c-9ed4af43fc3b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.707927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb308a-d04f-4a9b-9773-a0695f660813 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.712087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:32.712949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.713394 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.713896 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] PATH_INFO: `/v3/projects/123e170bb91141c283e0739f20d1d350` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.714114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c260b-3455-4bd0-88b5-fa7b6edffde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:32.714857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c260b-3455-4bd0-88b5-fa7b6edffde7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.715211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c260b-3455-4bd0-88b5-fa7b6edffde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.715861 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] RBAC: Authorizing `identity:delete_project(project_id=123e170bb91141c283e0739f20d1d350)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:32.717175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c260b-3455-4bd0-88b5-fa7b6edffde7 admin admin] PATH_INFO: `/v3/projects/4d91625aec064eeab9ce54d409bcfda3/users/2ee79dfaa82745a5a3debae675302297/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.718412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:32.743227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c260b-3455-4bd0-88b5-fa7b6edffde7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d91625aec064eeab9ce54d409bcfda3, user_id=2ee79dfaa82745a5a3debae675302297, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:32.747300 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c260b-3455-4bd0-88b5-fa7b6edffde7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:32.767038 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1302/2625] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:32 2022] PUT /identity/v3/projects/4d91625aec064eeab9ce54d409bcfda3/users/2ee79dfaa82745a5a3debae675302297/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:32.772892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c260b-3455-4bd0-88b5-fa7b6edffde7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:32.787243 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:32.805467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '123e170bb91141c283e0739f20d1d350', 'request_id': 'req-1f6076e1-053d-4eb5-bff9-4a85eb83923f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:32.826233 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '123e170bb91141c283e0739f20d1d350', 'request_id': 'req-1f6076e1-053d-4eb5-bff9-4a85eb83923f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:32.833345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '123e170bb91141c283e0739f20d1d350', 'request_id': 'req-1f6076e1-053d-4eb5-bff9-4a85eb83923f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:32.847951 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] The token cache is being invalidate because project 123e170bb91141c283e0739f20d1d350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:32.848286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:32.849060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1f6076e1-053d-4eb5-bff9-4a85eb83923f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:32.850686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1324/2626] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:32 2022] DELETE /identity/v3/projects/123e170bb91141c283e0739f20d1d350 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:32.855964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845acc-07fe-43f2-ade3-f9a835b7756d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.856572 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845acc-07fe-43f2-ade3-f9a835b7756d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.857151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845acc-07fe-43f2-ade3-f9a835b7756d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.864250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c260b-3455-4bd0-88b5-fa7b6edffde7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.884006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c2845acc-07fe-43f2-ade3-f9a835b7756d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:32.885478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c2845acc-07fe-43f2-ade3-f9a835b7756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:32.938217 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f449c-4d00-4f51-bbfa-7c88662cfd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:32.939151 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f449c-4d00-4f51-bbfa-7c88662cfd86 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.940230 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f449c-4d00-4f51-bbfa-7c88662cfd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.940590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f449c-4d00-4f51-bbfa-7c88662cfd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.941312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f449c-4d00-4f51-bbfa-7c88662cfd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:32.943234 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f449c-4d00-4f51-bbfa-7c88662cfd86 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:32.952293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1325/2627] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:32.960755 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ecc3-d369-4d5e-94c8-f3728f733e9d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:32.961366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ecc3-d369-4d5e-94c8-f3728f733e9d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:32.961904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ecc3-d369-4d5e-94c8-f3728f733e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:32.963391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1303/2628] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:32.967359 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f449c-4d00-4f51-bbfa-7c88662cfd86 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:32.969461 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-901f449c-4d00-4f51-bbfa-7c88662cfd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:32.990983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4149ecc3-d369-4d5e-94c8-f3728f733e9d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:32.992545 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4149ecc3-d369-4d5e-94c8-f3728f733e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:32.993954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f449c-4d00-4f51-bbfa-7c88662cfd86 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:32.999990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9f39f-3280-4268-bb55-4407fb9f9a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.000874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f39f-3280-4268-bb55-4407fb9f9a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.001298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f39f-3280-4268-bb55-4407fb9f9a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.001736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f39f-3280-4268-bb55-4407fb9f9a8f admin admin] PATH_INFO: `/v3/projects/4d91625aec064eeab9ce54d409bcfda3/users/2ee79dfaa82745a5a3debae675302297/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.003591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1326/2629] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:33.007121 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149ecc3-d369-4d5e-94c8-f3728f733e9d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:33.008090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9f39f-3280-4268-bb55-4407fb9f9a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d91625aec064eeab9ce54d409bcfda3, user_id=2ee79dfaa82745a5a3debae675302297, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.018721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9f39f-3280-4268-bb55-4407fb9f9a8f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:33.026316 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149ecc3-d369-4d5e-94c8-f3728f733e9d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:33.031604 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1304/2630] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:32 2022] PUT /identity/v3/projects/4d91625aec064eeab9ce54d409bcfda3/users/2ee79dfaa82745a5a3debae675302297/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:33.044944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b15d2-89ec-4a67-928f-b84b875e8e8c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.045481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b15d2-89ec-4a67-928f-b84b875e8e8c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.046529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b15d2-89ec-4a67-928f-b84b875e8e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.095877 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2d0b15d2-89ec-4a67-928f-b84b875e8e8c None None] MFA Rules not processed for user `2ee79dfaa82745a5a3debae675302297`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:33.097329 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2d0b15d2-89ec-4a67-928f-b84b875e8e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:33.104012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:33.139620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32f4f-8e1f-46dc-8a4d-f8eb4fe7303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.140284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32f4f-8e1f-46dc-8a4d-f8eb4fe7303d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.140567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32f4f-8e1f-46dc-8a4d-f8eb4fe7303d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.140838 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32f4f-8e1f-46dc-8a4d-f8eb4fe7303d admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.141506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32f4f-8e1f-46dc-8a4d-f8eb4fe7303d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:41:33.141818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32f4f-8e1f-46dc-8a4d-f8eb4fe7303d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.143607 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32f4f-8e1f-46dc-8a4d-f8eb4fe7303d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:33.157247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1327/2631] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:41:33.161307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32f4f-8e1f-46dc-8a4d-f8eb4fe7303d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:33.173372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32f4f-8e1f-46dc-8a4d-f8eb4fe7303d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:33.179135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919548bc-27d4-4328-9c53-28d0f273f24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.180033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919548bc-27d4-4328-9c53-28d0f273f24b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.180413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919548bc-27d4-4328-9c53-28d0f273f24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.180848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919548bc-27d4-4328-9c53-28d0f273f24b admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.181688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919548bc-27d4-4328-9c53-28d0f273f24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.184146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919548bc-27d4-4328-9c53-28d0f273f24b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:33.201740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1305/2632] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:33.214124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b15d2-89ec-4a67-928f-b84b875e8e8c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:33.219347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2d0b15d2-89ec-4a67-928f-b84b875e8e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:33.219513 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1328/2633] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:33 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:33.221446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919548bc-27d4-4328-9c53-28d0f273f24b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:33.273941 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:33.311767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b15d2-89ec-4a67-928f-b84b875e8e8c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:33.324443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919548bc-27d4-4328-9c53-28d0f273f24b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:33.330534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba454d01-efe7-422a-8fb1-e2a9e565a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.331275 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba454d01-efe7-422a-8fb1-e2a9e565a2bc admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.331586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba454d01-efe7-422a-8fb1-e2a9e565a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.331858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba454d01-efe7-422a-8fb1-e2a9e565a2bc admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.332497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba454d01-efe7-422a-8fb1-e2a9e565a2bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.334760 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba454d01-efe7-422a-8fb1-e2a9e565a2bc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:33.366014 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1329/2634] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:33 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:33.367129 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba454d01-efe7-422a-8fb1-e2a9e565a2bc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:33.369378 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae12d03-84a0-48f5-9984-1012a41d5a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.370072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12d03-84a0-48f5-9984-1012a41d5a15 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.370406 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12d03-84a0-48f5-9984-1012a41d5a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.370733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12d03-84a0-48f5-9984-1012a41d5a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.385716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba454d01-efe7-422a-8fb1-e2a9e565a2bc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:33.396505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb354-b0c4-45f8-8bd1-65f08f2d431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.397842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb354-b0c4-45f8-8bd1-65f08f2d431c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.398301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb354-b0c4-45f8-8bd1-65f08f2d431c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.399097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb354-b0c4-45f8-8bd1-65f08f2d431c admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.400126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643eb354-b0c4-45f8-8bd1-65f08f2d431c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.403690 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643eb354-b0c4-45f8-8bd1-65f08f2d431c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:33.419463 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1330/2635] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:33.422225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb354-b0c4-45f8-8bd1-65f08f2d431c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:33.441375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae12d03-84a0-48f5-9984-1012a41d5a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.442816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae12d03-84a0-48f5-9984-1012a41d5a15 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:33.444288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb354-b0c4-45f8-8bd1-65f08f2d431c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:33.467296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd773c-852c-4d4d-b1c9-66a4804a52d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.467967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd773c-852c-4d4d-b1c9-66a4804a52d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.468244 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd773c-852c-4d4d-b1c9-66a4804a52d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.468511 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd773c-852c-4d4d-b1c9-66a4804a52d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.469220 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd773c-852c-4d4d-b1c9-66a4804a52d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.470854 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd773c-852c-4d4d-b1c9-66a4804a52d4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:33.473081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1306/2636] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:33.485058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1331/2637] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:33.490274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae12d03-84a0-48f5-9984-1012a41d5a15 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:33.502254 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae12d03-84a0-48f5-9984-1012a41d5a15 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:33.507250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d2209-9be5-4c01-a6a0-0c62b5131c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.508078 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2209-9be5-4c01-a6a0-0c62b5131c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.508528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2209-9be5-4c01-a6a0-0c62b5131c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.508864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2209-9be5-4c01-a6a0-0c62b5131c0c admin admin] PATH_INFO: `/v3/projects/d63ce1d014fd4ef39ab5021e4010064a/users/28387ddeb55c4989b64a352a32789746/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.531833 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d2209-9be5-4c01-a6a0-0c62b5131c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63ce1d014fd4ef39ab5021e4010064a, user_id=28387ddeb55c4989b64a352a32789746, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.535062 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d2209-9be5-4c01-a6a0-0c62b5131c0c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:33.560798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1307/2638] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:33 2022] PUT /identity/v3/projects/d63ce1d014fd4ef39ab5021e4010064a/users/28387ddeb55c4989b64a352a32789746/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:33.563437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec135d6-e68b-4b88-b02e-9699bf0ca379 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.563758 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec135d6-e68b-4b88-b02e-9699bf0ca379 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.564098 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec135d6-e68b-4b88-b02e-9699bf0ca379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.604565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4ec135d6-e68b-4b88-b02e-9699bf0ca379 None None] MFA Rules not processed for user `28387ddeb55c4989b64a352a32789746`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:33.605812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4ec135d6-e68b-4b88-b02e-9699bf0ca379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:33.611143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d2209-9be5-4c01-a6a0-0c62b5131c0c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:33.716564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d2209-9be5-4c01-a6a0-0c62b5131c0c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:33.718586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1332/2639] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:33.720903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159ab62-81d1-40c4-ae54-e9667ad1946d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.722352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159ab62-81d1-40c4-ae54-e9667ad1946d service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.723404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159ab62-81d1-40c4-ae54-e9667ad1946d service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.723527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec135d6-e68b-4b88-b02e-9699bf0ca379 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:33.723616 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159ab62-81d1-40c4-ae54-e9667ad1946d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.725095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f159ab62-81d1-40c4-ae54-e9667ad1946d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:33.745693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:33.775211 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:33.836030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec135d6-e68b-4b88-b02e-9699bf0ca379 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:33.841820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aed3f-68a2-4e29-9684-5d5ee1af1a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.843065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aed3f-68a2-4e29-9684-5d5ee1af1a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.843565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aed3f-68a2-4e29-9684-5d5ee1af1a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.843989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aed3f-68a2-4e29-9684-5d5ee1af1a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.844925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aed3f-68a2-4e29-9684-5d5ee1af1a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.847458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aed3f-68a2-4e29-9684-5d5ee1af1a51 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:33.870323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159ab62-81d1-40c4-ae54-e9667ad1946d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.872270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159ab62-81d1-40c4-ae54-e9667ad1946d service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:33.884410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1308/2640] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:33.911221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1333/2641] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:33 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:41:33.912440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159ab62-81d1-40c4-ae54-e9667ad1946d service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:33.925287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159ab62-81d1-40c4-ae54-e9667ad1946d service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:33.995844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675c989-ce6e-4047-9f83-e919ef3384a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:33.996458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675c989-ce6e-4047-9f83-e919ef3384a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:33.996766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675c989-ce6e-4047-9f83-e919ef3384a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:33.997031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675c989-ce6e-4047-9f83-e919ef3384a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:33.997774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675c989-ce6e-4047-9f83-e919ef3384a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:33.999783 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675c989-ce6e-4047-9f83-e919ef3384a1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:34.051831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1309/2642] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:33 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:41:34.056523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aed3f-68a2-4e29-9684-5d5ee1af1a51 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:34.068486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aed3f-68a2-4e29-9684-5d5ee1af1a51 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:34.074012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bf264-6339-408c-a6b8-36e782e4f7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:34.074677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bf264-6339-408c-a6b8-36e782e4f7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:34.075135 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bf264-6339-408c-a6b8-36e782e4f7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:34.075543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bf264-6339-408c-a6b8-36e782e4f7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:34.076247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bf264-6339-408c-a6b8-36e782e4f7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:34.077867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bf264-6339-408c-a6b8-36e782e4f7b3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:34.088315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1334/2643] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:34.093819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675c989-ce6e-4047-9f83-e919ef3384a1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:34.106957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675c989-ce6e-4047-9f83-e919ef3384a1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:34.124779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f69be9-b9fc-4500-bb68-715f09a6691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:34.125417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69be9-b9fc-4500-bb68-715f09a6691c admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:34.125686 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69be9-b9fc-4500-bb68-715f09a6691c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:34.125960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69be9-b9fc-4500-bb68-715f09a6691c admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:34.126682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f69be9-b9fc-4500-bb68-715f09a6691c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:34.128645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f69be9-b9fc-4500-bb68-715f09a6691c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:34.153278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1310/2644] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:34.155242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bf264-6339-408c-a6b8-36e782e4f7b3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:34.166087 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bf264-6339-408c-a6b8-36e782e4f7b3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:34.171771 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f018ed1-58f8-4567-88f3-a7af55860a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:34.172543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f018ed1-58f8-4567-88f3-a7af55860a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:34.172916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f018ed1-58f8-4567-88f3-a7af55860a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:34.173331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f018ed1-58f8-4567-88f3-a7af55860a37 admin admin] PATH_INFO: `/v3/projects/e32cd17236fb415499a2d8d869385415/users/453605302ead4fa298da054652ccb422/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:34.189850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f018ed1-58f8-4567-88f3-a7af55860a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32cd17236fb415499a2d8d869385415, user_id=453605302ead4fa298da054652ccb422, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:34.192800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f018ed1-58f8-4567-88f3-a7af55860a37 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:34.238960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1335/2645] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:34 2022] PUT /identity/v3/projects/e32cd17236fb415499a2d8d869385415/users/453605302ead4fa298da054652ccb422/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:34.250097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fdab0-7ce3-4236-be9d-391a70c9d877 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:34.250574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fdab0-7ce3-4236-be9d-391a70c9d877 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:34.250930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fdab0-7ce3-4236-be9d-391a70c9d877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:34.300906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2e3fdab0-7ce3-4236-be9d-391a70c9d877 None None] MFA Rules not processed for user `453605302ead4fa298da054652ccb422`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:34.302872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2e3fdab0-7ce3-4236-be9d-391a70c9d877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:34.383711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1311/2646] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:34.388728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f018ed1-58f8-4567-88f3-a7af55860a37 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:34.459111 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f018ed1-58f8-4567-88f3-a7af55860a37 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:34.463765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522316-5a7e-4a86-a572-21bf15d2cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:34.464375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522316-5a7e-4a86-a572-21bf15d2cbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:34.464651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522316-5a7e-4a86-a572-21bf15d2cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:34.464921 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522316-5a7e-4a86-a572-21bf15d2cbd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:34.465602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2522316-5a7e-4a86-a572-21bf15d2cbd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:34.467544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2522316-5a7e-4a86-a572-21bf15d2cbd0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:34.501986 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1336/2647] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:34 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:41:34.503118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fdab0-7ce3-4236-be9d-391a70c9d877 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:34.515646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fdab0-7ce3-4236-be9d-391a70c9d877 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:34.545571 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:34.580133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986b4e-1b77-4c78-b222-197d949cd36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:34.580856 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986b4e-1b77-4c78-b222-197d949cd36e admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:34.581206 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986b4e-1b77-4c78-b222-197d949cd36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:34.581551 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986b4e-1b77-4c78-b222-197d949cd36e admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:34.582269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986b4e-1b77-4c78-b222-197d949cd36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:34.584324 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986b4e-1b77-4c78-b222-197d949cd36e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:34.612208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1312/2648] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:34 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:41:34.613479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522316-5a7e-4a86-a572-21bf15d2cbd0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:34.624734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522316-5a7e-4a86-a572-21bf15d2cbd0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:34.629794 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3eb720-d333-43a4-a5e0-acf2542de4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:34.630431 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3eb720-d333-43a4-a5e0-acf2542de4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:34.630712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3eb720-d333-43a4-a5e0-acf2542de4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:34.630985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3eb720-d333-43a4-a5e0-acf2542de4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:34.631696 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3eb720-d333-43a4-a5e0-acf2542de4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:34.633331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3eb720-d333-43a4-a5e0-acf2542de4a1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:34.646661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1337/2649] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:34.651333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986b4e-1b77-4c78-b222-197d949cd36e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:34.662792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986b4e-1b77-4c78-b222-197d949cd36e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:34.668994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74234463-b331-46eb-8bce-41bba8483b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:34.669375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74234463-b331-46eb-8bce-41bba8483b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:34.669774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74234463-b331-46eb-8bce-41bba8483b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:34.670079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74234463-b331-46eb-8bce-41bba8483b98 admin admin] PATH_INFO: `/v3/projects/6c4cbd92b963404a9f9c98ca34df3ba7/users/18932225e11347d894f15d684eee1997/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:34.691389 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74234463-b331-46eb-8bce-41bba8483b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4cbd92b963404a9f9c98ca34df3ba7, user_id=18932225e11347d894f15d684eee1997, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:34.695561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74234463-b331-46eb-8bce-41bba8483b98 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:34.711648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1313/2650] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:34 2022] PUT /identity/v3/projects/6c4cbd92b963404a9f9c98ca34df3ba7/users/18932225e11347d894f15d684eee1997/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:34.715781 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3eb720-d333-43a4-a5e0-acf2542de4a1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:34.725989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3eb720-d333-43a4-a5e0-acf2542de4a1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:34.899159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:34.928136 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5968fc9-abcb-4873-a5fd-99cb7a0b1617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:34.928972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5968fc9-abcb-4873-a5fd-99cb7a0b1617 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:34.929264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5968fc9-abcb-4873-a5fd-99cb7a0b1617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:34.929540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5968fc9-abcb-4873-a5fd-99cb7a0b1617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:34.930298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5968fc9-abcb-4873-a5fd-99cb7a0b1617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:34.932093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5968fc9-abcb-4873-a5fd-99cb7a0b1617 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:34.945075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1338/2651] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:34.949585 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74234463-b331-46eb-8bce-41bba8483b98 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:34.962997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74234463-b331-46eb-8bce-41bba8483b98 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:34.969291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af1ca3-2010-4bc3-981e-01b82657ff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:34.969990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af1ca3-2010-4bc3-981e-01b82657ff52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:34.970266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af1ca3-2010-4bc3-981e-01b82657ff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:34.970537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af1ca3-2010-4bc3-981e-01b82657ff52 admin admin] PATH_INFO: `/v3/projects/6c4cbd92b963404a9f9c98ca34df3ba7/users/18932225e11347d894f15d684eee1997/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:34.973067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af1ca3-2010-4bc3-981e-01b82657ff52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4cbd92b963404a9f9c98ca34df3ba7, user_id=18932225e11347d894f15d684eee1997, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:34.976302 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af1ca3-2010-4bc3-981e-01b82657ff52 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:34.995772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1314/2652] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:34 2022] PUT /identity/v3/projects/6c4cbd92b963404a9f9c98ca34df3ba7/users/18932225e11347d894f15d684eee1997/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:35.007849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9ab6-5f40-4517-a56d-6d918eff28e2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:35.008240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9ab6-5f40-4517-a56d-6d918eff28e2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:35.008514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9ab6-5f40-4517-a56d-6d918eff28e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:35.045329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9d9b9ab6-5f40-4517-a56d-6d918eff28e2 None None] MFA Rules not processed for user `18932225e11347d894f15d684eee1997`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:35.046747 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9d9b9ab6-5f40-4517-a56d-6d918eff28e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:35.190304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1339/2653] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:35.202683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af1ca3-2010-4bc3-981e-01b82657ff52 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:35.278840 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af1ca3-2010-4bc3-981e-01b82657ff52 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:35.282303 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3c934-67e4-4238-9922-a855d306ed84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:35.282902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c934-67e4-4238-9922-a855d306ed84 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:35.283176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c934-67e4-4238-9922-a855d306ed84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:35.283468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c934-67e4-4238-9922-a855d306ed84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:35.346534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3c934-67e4-4238-9922-a855d306ed84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:35.348012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3c934-67e4-4238-9922-a855d306ed84 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:35.358223 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1315/2654] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:36.924550 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b9ab6-5f40-4517-a56d-6d918eff28e2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:36.926765 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9d9b9ab6-5f40-4517-a56d-6d918eff28e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:36.939672 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b9ab6-5f40-4517-a56d-6d918eff28e2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:36.943365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b902ec-4622-4039-a2ac-d813e1b0ac86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:36.944008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b902ec-4622-4039-a2ac-d813e1b0ac86 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:36.944256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b902ec-4622-4039-a2ac-d813e1b0ac86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:36.944544 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b902ec-4622-4039-a2ac-d813e1b0ac86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:37.005160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b902ec-4622-4039-a2ac-d813e1b0ac86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:37.006586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b902ec-4622-4039-a2ac-d813e1b0ac86 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:37.017528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1340/2655] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:37.614536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3c934-67e4-4238-9922-a855d306ed84 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:37.624384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3c934-67e4-4238-9922-a855d306ed84 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:37.628034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743efb4a-4bee-4e51-88e9-bc5b13dbaac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:37.628635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743efb4a-4bee-4e51-88e9-bc5b13dbaac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:37.628904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743efb4a-4bee-4e51-88e9-bc5b13dbaac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:37.629163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743efb4a-4bee-4e51-88e9-bc5b13dbaac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:37.639137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743efb4a-4bee-4e51-88e9-bc5b13dbaac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:37.640618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743efb4a-4bee-4e51-88e9-bc5b13dbaac4 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:37.650030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1316/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:38.991090 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b902ec-4622-4039-a2ac-d813e1b0ac86 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:39.055461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:39.060646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b902ec-4622-4039-a2ac-d813e1b0ac86 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:39.071015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:39.071911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:39.072242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:39.072885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] PATH_INFO: `/v3/users/45a8f24b87ee4ec6a2afd26d46e818e8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:39.074034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a8f24b87ee4ec6a2afd26d46e818e8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:39.076020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:39.125451 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a8f24b87ee4ec6a2afd26d46e818e8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.133349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a8f24b87ee4ec6a2afd26d46e818e8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.146049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a8f24b87ee4ec6a2afd26d46e818e8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.146702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a8f24b87ee4ec6a2afd26d46e818e8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.153356 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a8f24b87ee4ec6a2afd26d46e818e8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.159271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1341/2657] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:38 2022] DELETE /identity/v3/users/45a8f24b87ee4ec6a2afd26d46e818e8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:39.163917 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfe589-a382-4904-be76-9d83e90d0200 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:39.164454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfe589-a382-4904-be76-9d83e90d0200 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:39.164454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfe589-a382-4904-be76-9d83e90d0200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:39.184715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7cdfe589-a382-4904-be76-9d83e90d0200 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:39.185927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7cdfe589-a382-4904-be76-9d83e90d0200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:39.203516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:39.248039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1317/2658] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:39.258414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:39.259970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:39.320331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f913dec-070b-4d40-a88d-bdefffcb15be admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:39.324227 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bac12-5269-4d5a-aba2-c28711d25d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:39.324829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bac12-5269-4d5a-aba2-c28711d25d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:39.325100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bac12-5269-4d5a-aba2-c28711d25d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:39.325384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bac12-5269-4d5a-aba2-c28711d25d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:39.334999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bac12-5269-4d5a-aba2-c28711d25d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:39.336496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bac12-5269-4d5a-aba2-c28711d25d32 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:39.346076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1342/2659] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:39.645393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfe589-a382-4904-be76-9d83e90d0200 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:39.646903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7cdfe589-a382-4904-be76-9d83e90d0200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:39.660084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfe589-a382-4904-be76-9d83e90d0200 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:39.666006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:39.666758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:39.667032 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:39.667380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] PATH_INFO: `/v3/projects/4b1cd83889cf48c79d39fe17c31e376c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:39.669384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1cd83889cf48c79d39fe17c31e376c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:39.671918 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:39.717530 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1cd83889cf48c79d39fe17c31e376c', 'request_id': 'req-73d6a586-10b9-4ecc-99f7-b2433420e2a4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.724695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1cd83889cf48c79d39fe17c31e376c', 'request_id': 'req-73d6a586-10b9-4ecc-99f7-b2433420e2a4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.730030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1cd83889cf48c79d39fe17c31e376c', 'request_id': 'req-73d6a586-10b9-4ecc-99f7-b2433420e2a4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.741216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] The token cache is being invalidate because project 4b1cd83889cf48c79d39fe17c31e376c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:39.741496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.742109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.743676 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1318/2660] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:39 2022] DELETE /identity/v3/projects/4b1cd83889cf48c79d39fe17c31e376c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:39.747907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bac12-5269-4d5a-aba2-c28711d25d32 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:39.757789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bac12-5269-4d5a-aba2-c28711d25d32 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:39.819058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:39.819741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:39.820034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:39.820305 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] PATH_INFO: `/v3/users/2ee79dfaa82745a5a3debae675302297` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:39.821512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee79dfaa82745a5a3debae675302297)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:39.823542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:39.846038 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:39.875203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee79dfaa82745a5a3debae675302297'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.884289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee79dfaa82745a5a3debae675302297'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.896669 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee79dfaa82745a5a3debae675302297'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.897370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee79dfaa82745a5a3debae675302297'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.904716 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4cee3c4b-b084-4e3f-89a6-4c70301c3540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee79dfaa82745a5a3debae675302297'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:39.910922 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1343/2661] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:39 2022] DELETE /identity/v3/users/2ee79dfaa82745a5a3debae675302297 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:40.195927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:40.197504 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:40.211045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6a586-10b9-4ecc-99f7-b2433420e2a4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:40.288169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:40.288800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:40.289061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:40.289351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] PATH_INFO: `/v3/projects/4d91625aec064eeab9ce54d409bcfda3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:40.290416 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d91625aec064eeab9ce54d409bcfda3)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:40.292409 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:40.342087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:40.344490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d91625aec064eeab9ce54d409bcfda3', 'request_id': 'req-10e247b5-51fd-492b-a70f-3c5e8bb598a0'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:40.354371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d91625aec064eeab9ce54d409bcfda3', 'request_id': 'req-10e247b5-51fd-492b-a70f-3c5e8bb598a0'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:40.360755 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d91625aec064eeab9ce54d409bcfda3', 'request_id': 'req-10e247b5-51fd-492b-a70f-3c5e8bb598a0'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:40.372469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] The token cache is being invalidate because project 4d91625aec064eeab9ce54d409bcfda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:40.372836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:40.373594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-10e247b5-51fd-492b-a70f-3c5e8bb598a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:40.375528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1319/2662] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:40 2022] DELETE /identity/v3/projects/4d91625aec064eeab9ce54d409bcfda3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:40.380663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2155-f41b-479f-a1e0-2b271ba30f98 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:40.381126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2155-f41b-479f-a1e0-2b271ba30f98 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:40.381247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2155-f41b-479f-a1e0-2b271ba30f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:40.401284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b79c2155-f41b-479f-a1e0-2b271ba30f98 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:40.402479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b79c2155-f41b-479f-a1e0-2b271ba30f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:40.468283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1344/2663] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:40.476469 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c2ae3-bc60-4cc1-9e1b-01e367071d71 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:40.476771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c2ae3-bc60-4cc1-9e1b-01e367071d71 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:40.477039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c2ae3-bc60-4cc1-9e1b-01e367071d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:40.497441 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-851c2ae3-bc60-4cc1-9e1b-01e367071d71 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:40.498637 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-851c2ae3-bc60-4cc1-9e1b-01e367071d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:40.506549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1320/2664] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:40.510870 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c2155-f41b-479f-a1e0-2b271ba30f98 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:40.520738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c2155-f41b-479f-a1e0-2b271ba30f98 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:40.526393 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cbda1-5bf5-4627-a066-934c8a794133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:40.526995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbda1-5bf5-4627-a066-934c8a794133 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:40.527265 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbda1-5bf5-4627-a066-934c8a794133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:40.527561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbda1-5bf5-4627-a066-934c8a794133 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:40.528205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cbda1-5bf5-4627-a066-934c8a794133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:41:40.528502 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cbda1-5bf5-4627-a066-934c8a794133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:40.530079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cbda1-5bf5-4627-a066-934c8a794133 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:40.542057 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1345/2665] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:41:40.546381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c2ae3-bc60-4cc1-9e1b-01e367071d71 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:40.555597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c2ae3-bc60-4cc1-9e1b-01e367071d71 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:40.560346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce21975-b302-48d0-9ea6-90849287999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:40.560937 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce21975-b302-48d0-9ea6-90849287999f admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:40.561204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce21975-b302-48d0-9ea6-90849287999f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:40.561507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce21975-b302-48d0-9ea6-90849287999f admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:40.562130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce21975-b302-48d0-9ea6-90849287999f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:40.564059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce21975-b302-48d0-9ea6-90849287999f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:40.592532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1321/2666] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:40 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:40.597055 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cbda1-5bf5-4627-a066-934c8a794133 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:40.607412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cbda1-5bf5-4627-a066-934c8a794133 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:40.666744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc091d4-41be-4117-a3e3-acabd1d674c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:40.667274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc091d4-41be-4117-a3e3-acabd1d674c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:40.667582 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc091d4-41be-4117-a3e3-acabd1d674c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:40.667849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc091d4-41be-4117-a3e3-acabd1d674c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:40.668490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc091d4-41be-4117-a3e3-acabd1d674c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:40.670419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc091d4-41be-4117-a3e3-acabd1d674c4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:40.691655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1346/2667] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:40 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:40.697316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce21975-b302-48d0-9ea6-90849287999f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:40.709592 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce21975-b302-48d0-9ea6-90849287999f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:40.715345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad139ab1-093d-4958-a4cc-58439c1e25c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:40.715953 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad139ab1-093d-4958-a4cc-58439c1e25c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:40.716226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad139ab1-093d-4958-a4cc-58439c1e25c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:40.716473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad139ab1-093d-4958-a4cc-58439c1e25c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:40.717193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad139ab1-093d-4958-a4cc-58439c1e25c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:40.719675 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad139ab1-093d-4958-a4cc-58439c1e25c9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:40.731031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1322/2668] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:40.735203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc091d4-41be-4117-a3e3-acabd1d674c4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:40.745644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc091d4-41be-4117-a3e3-acabd1d674c4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:40.750534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25844895-3aef-45cb-b719-61a0d1cb68c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:40.751134 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25844895-3aef-45cb-b719-61a0d1cb68c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:40.751435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25844895-3aef-45cb-b719-61a0d1cb68c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:40.751704 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25844895-3aef-45cb-b719-61a0d1cb68c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:40.752335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25844895-3aef-45cb-b719-61a0d1cb68c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:40.753927 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25844895-3aef-45cb-b719-61a0d1cb68c0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:40.764433 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1347/2669] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:40.770696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad139ab1-093d-4958-a4cc-58439c1e25c9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:40.782191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad139ab1-093d-4958-a4cc-58439c1e25c9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:40.789397 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500087a-a870-49fb-ba9d-7f3928024a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:40.790303 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500087a-a870-49fb-ba9d-7f3928024a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:40.790712 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500087a-a870-49fb-ba9d-7f3928024a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:40.791106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500087a-a870-49fb-ba9d-7f3928024a0b admin admin] PATH_INFO: `/v3/projects/177597d3048840fba33ef780551d929c/users/e611e694efdc4714a4dde08d9a6d5577/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:40.807526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500087a-a870-49fb-ba9d-7f3928024a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=177597d3048840fba33ef780551d929c, user_id=e611e694efdc4714a4dde08d9a6d5577, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:40.810159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500087a-a870-49fb-ba9d-7f3928024a0b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:40.824093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1323/2670] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:40 2022] PUT /identity/v3/projects/177597d3048840fba33ef780551d929c/users/e611e694efdc4714a4dde08d9a6d5577/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:40.829492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8210d-525a-4e78-bbbd-c42bd099e37c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:40.829770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8210d-525a-4e78-bbbd-c42bd099e37c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:40.830035 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8210d-525a-4e78-bbbd-c42bd099e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:40.838125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:40.851543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-04d8210d-525a-4e78-bbbd-c42bd099e37c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:40.852734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-04d8210d-525a-4e78-bbbd-c42bd099e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:40.916157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1348/2671] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:40.927986 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500087a-a870-49fb-ba9d-7f3928024a0b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:40.929988 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b500087a-a870-49fb-ba9d-7f3928024a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:40.997422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500087a-a870-49fb-ba9d-7f3928024a0b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:41.001749 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b93e3-819f-411a-bb46-61a0fe1bc467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:41.002516 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b93e3-819f-411a-bb46-61a0fe1bc467 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:41.002884 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b93e3-819f-411a-bb46-61a0fe1bc467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:41.003251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b93e3-819f-411a-bb46-61a0fe1bc467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:41.013005 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b93e3-819f-411a-bb46-61a0fe1bc467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:41.014474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b93e3-819f-411a-bb46-61a0fe1bc467 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:41.024805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1324/2672] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:41.566340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8210d-525a-4e78-bbbd-c42bd099e37c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:41.568082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-04d8210d-525a-4e78-bbbd-c42bd099e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:41.581215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8210d-525a-4e78-bbbd-c42bd099e37c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:41.587023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:41.587720 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:41.587993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:41.588257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] PATH_INFO: `/v3/users/28387ddeb55c4989b64a352a32789746` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:41.589599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28387ddeb55c4989b64a352a32789746)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:41.591573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:41.647359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28387ddeb55c4989b64a352a32789746'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:41.656432 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28387ddeb55c4989b64a352a32789746'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:41.670033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28387ddeb55c4989b64a352a32789746'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:41.670737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28387ddeb55c4989b64a352a32789746'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:41.678471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28387ddeb55c4989b64a352a32789746'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:41.685113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1349/2673] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:41 2022] DELETE /identity/v3/users/28387ddeb55c4989b64a352a32789746 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:41.690046 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fa0b2-6e59-4b5f-9271-d8aa2f7aca63 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:41.690643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fa0b2-6e59-4b5f-9271-d8aa2f7aca63 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:41.690643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fa0b2-6e59-4b5f-9271-d8aa2f7aca63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:41.711030 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c34fa0b2-6e59-4b5f-9271-d8aa2f7aca63 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:41.712375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c34fa0b2-6e59-4b5f-9271-d8aa2f7aca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:41.783124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1325/2674] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:41.796358 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:41.797949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:41.863703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0571ec-b1b9-4677-9aa1-8b560c708a38 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:41.867370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a65327-5a1e-4130-b8b1-f0a7560864c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:41.868023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65327-5a1e-4130-b8b1-f0a7560864c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:41.868300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65327-5a1e-4130-b8b1-f0a7560864c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:41.868570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65327-5a1e-4130-b8b1-f0a7560864c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:41.878180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a65327-5a1e-4130-b8b1-f0a7560864c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:41.879667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a65327-5a1e-4130-b8b1-f0a7560864c6 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:41.889437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1350/2675] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:42.083387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ac8d9-80ee-4637-91ce-41372ff53b22 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:42.083896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ac8d9-80ee-4637-91ce-41372ff53b22 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:42.084167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ac8d9-80ee-4637-91ce-41372ff53b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:42.118892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d48ac8d9-80ee-4637-91ce-41372ff53b22 None None] MFA Rules not processed for user `e611e694efdc4714a4dde08d9a6d5577`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:42.120296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d48ac8d9-80ee-4637-91ce-41372ff53b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:42.125477 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:42.194995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a65327-5a1e-4130-b8b1-f0a7560864c6 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:42.200438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-91a65327-5a1e-4130-b8b1-f0a7560864c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:42.236724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1326/2676] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:42.242193 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ac8d9-80ee-4637-91ce-41372ff53b22 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:42.243446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a65327-5a1e-4130-b8b1-f0a7560864c6 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:42.245130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d48ac8d9-80ee-4637-91ce-41372ff53b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:42.254174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:42.255159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:42.255628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:42.256579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] PATH_INFO: `/v3/projects/d63ce1d014fd4ef39ab5021e4010064a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:42.258559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63ce1d014fd4ef39ab5021e4010064a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:42.263457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:42.280325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ac8d9-80ee-4637-91ce-41372ff53b22 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:42.289995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130a45c-4161-4eaf-9bb6-8892670cac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:42.291531 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130a45c-4161-4eaf-9bb6-8892670cac99 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:42.291883 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130a45c-4161-4eaf-9bb6-8892670cac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:42.292352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130a45c-4161-4eaf-9bb6-8892670cac99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:42.293133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130a45c-4161-4eaf-9bb6-8892670cac99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:42.296717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130a45c-4161-4eaf-9bb6-8892670cac99 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:42.325171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:42.350112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1327/2677] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:42 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:42.354618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130a45c-4161-4eaf-9bb6-8892670cac99 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:42.382379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63ce1d014fd4ef39ab5021e4010064a', 'request_id': 'req-fc732e8e-0a2a-419b-9f23-aea6cc891603'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:42.394912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63ce1d014fd4ef39ab5021e4010064a', 'request_id': 'req-fc732e8e-0a2a-419b-9f23-aea6cc891603'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:42.404814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63ce1d014fd4ef39ab5021e4010064a', 'request_id': 'req-fc732e8e-0a2a-419b-9f23-aea6cc891603'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:42.422120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] The token cache is being invalidate because project d63ce1d014fd4ef39ab5021e4010064a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:42.422673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:42.423676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:42.426274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1351/2678] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:42 2022] DELETE /identity/v3/projects/d63ce1d014fd4ef39ab5021e4010064a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:42.430395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:42.434271 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:42.436044 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130a45c-4161-4eaf-9bb6-8892670cac99 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:42.549114 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb45fb-1e99-410c-8f58-7d38831c0fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:42.549822 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb45fb-1e99-410c-8f58-7d38831c0fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:42.550096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb45fb-1e99-410c-8f58-7d38831c0fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:42.550247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc732e8e-0a2a-419b-9f23-aea6cc891603 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:42.550511 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb45fb-1e99-410c-8f58-7d38831c0fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:42.551393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb45fb-1e99-410c-8f58-7d38831c0fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:42.554001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb45fb-1e99-410c-8f58-7d38831c0fb2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:42.556428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:42.557082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:42.557359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:42.557777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] PATH_INFO: `/v3/users/453605302ead4fa298da054652ccb422` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:42.559084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453605302ead4fa298da054652ccb422)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:42.561237 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:42.585995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1328/2679] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:42 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:42.587126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb45fb-1e99-410c-8f58-7d38831c0fb2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:42.590532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-dbeb45fb-1e99-410c-8f58-7d38831c0fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:42.605661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb45fb-1e99-410c-8f58-7d38831c0fb2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:42.611625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8affab-2d56-4024-b528-5cf1146e1f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:42.612460 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8affab-2d56-4024-b528-5cf1146e1f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:42.612880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8affab-2d56-4024-b528-5cf1146e1f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:42.613296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8affab-2d56-4024-b528-5cf1146e1f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:42.614239 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8affab-2d56-4024-b528-5cf1146e1f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:42.616321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8affab-2d56-4024-b528-5cf1146e1f6e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:42.633750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1329/2680] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:42.635088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8affab-2d56-4024-b528-5cf1146e1f6e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:42.638281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453605302ead4fa298da054652ccb422'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:42.647660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8affab-2d56-4024-b528-5cf1146e1f6e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:42.652590 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453605302ead4fa298da054652ccb422'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:42.655200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff582df-0979-4c76-af3b-7e7327c82182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:42.656306 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff582df-0979-4c76-af3b-7e7327c82182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:42.656584 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff582df-0979-4c76-af3b-7e7327c82182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:42.656848 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff582df-0979-4c76-af3b-7e7327c82182 admin admin] PATH_INFO: `/v3/projects/04899e14c1d54a46a91fa4efa1ddbd00/users/bfaad410ba79482f8caf3e0fde65b779/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:42.661458 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:42.677644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453605302ead4fa298da054652ccb422'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:42.678357 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453605302ead4fa298da054652ccb422'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:42.678899 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff582df-0979-4c76-af3b-7e7327c82182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04899e14c1d54a46a91fa4efa1ddbd00, user_id=bfaad410ba79482f8caf3e0fde65b779, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:42.682486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff582df-0979-4c76-af3b-7e7327c82182 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:42.688538 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453605302ead4fa298da054652ccb422'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:42.698685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1352/2681] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:42 2022] DELETE /identity/v3/users/453605302ead4fa298da054652ccb422 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:42.698874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1330/2682] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:42 2022] PUT /identity/v3/projects/04899e14c1d54a46a91fa4efa1ddbd00/users/bfaad410ba79482f8caf3e0fde65b779/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:41:42.702902 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:42.704325 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:42.735723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:42.788372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e011b-f495-47c6-892e-f86dbbeab214 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:42.793106 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac0017-62a2-47cf-ab58-078426605a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:42.793728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac0017-62a2-47cf-ab58-078426605a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:42.794047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac0017-62a2-47cf-ab58-078426605a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:42.794318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac0017-62a2-47cf-ab58-078426605a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:42.794999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac0017-62a2-47cf-ab58-078426605a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:42.796972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac0017-62a2-47cf-ab58-078426605a4a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:42.807549 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1353/2683] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:42.812188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff582df-0979-4c76-af3b-7e7327c82182 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:42.884958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff582df-0979-4c76-af3b-7e7327c82182 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:42.890805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27225b1b-a684-49b3-bf81-7511e6e7a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:42.892258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27225b1b-a684-49b3-bf81-7511e6e7a3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:42.892599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27225b1b-a684-49b3-bf81-7511e6e7a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:42.892932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27225b1b-a684-49b3-bf81-7511e6e7a3f0 admin admin] PATH_INFO: `/v3/projects/04899e14c1d54a46a91fa4efa1ddbd00/users/bfaad410ba79482f8caf3e0fde65b779/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:42.895696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27225b1b-a684-49b3-bf81-7511e6e7a3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04899e14c1d54a46a91fa4efa1ddbd00, user_id=bfaad410ba79482f8caf3e0fde65b779, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:42.898417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27225b1b-a684-49b3-bf81-7511e6e7a3f0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:42.910603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1331/2684] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:42 2022] PUT /identity/v3/projects/04899e14c1d54a46a91fa4efa1ddbd00/users/bfaad410ba79482f8caf3e0fde65b779/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:43.053257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac0017-62a2-47cf-ab58-078426605a4a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:43.055189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f7ac0017-62a2-47cf-ab58-078426605a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:43.076010 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac0017-62a2-47cf-ab58-078426605a4a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:43.149871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:43.150645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:43.151112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:43.151478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] PATH_INFO: `/v3/projects/e32cd17236fb415499a2d8d869385415` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:43.153106 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32cd17236fb415499a2d8d869385415)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:43.155355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:43.212165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32cd17236fb415499a2d8d869385415', 'request_id': 'req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.221865 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32cd17236fb415499a2d8d869385415', 'request_id': 'req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.230800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32cd17236fb415499a2d8d869385415', 'request_id': 'req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.245261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] The token cache is being invalidate because project e32cd17236fb415499a2d8d869385415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:43.245844 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.246457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.251558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1354/2685] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:43 2022] DELETE /identity/v3/projects/e32cd17236fb415499a2d8d869385415 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:43.253440 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27225b1b-a684-49b3-bf81-7511e6e7a3f0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:43.255335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-27225b1b-a684-49b3-bf81-7511e6e7a3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:43.268490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27225b1b-a684-49b3-bf81-7511e6e7a3f0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:43.330096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:43.330766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:43.331041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:43.331346 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] PATH_INFO: `/v3/users/18932225e11347d894f15d684eee1997` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:43.332556 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] RBAC: Authorizing `identity:delete_user(user_id=18932225e11347d894f15d684eee1997)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:43.334488 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:43.409166 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18932225e11347d894f15d684eee1997'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.409839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18932225e11347d894f15d684eee1997'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.421099 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18932225e11347d894f15d684eee1997'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.437025 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18932225e11347d894f15d684eee1997'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.444325 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-92e2ec4d-0861-4e9e-bc93-9de72551480b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18932225e11347d894f15d684eee1997'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.446106 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:43.455864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1332/2686] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:41:43 2022] DELETE /identity/v3/users/18932225e11347d894f15d684eee1997 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:43.843715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:43.854934 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d154f3a-84fd-46b6-8a9e-d03316d84b3a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:43.903799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:43.918506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:43.919156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:43.919468 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:43.919737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] PATH_INFO: `/v3/projects/6c4cbd92b963404a9f9c98ca34df3ba7` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:43.920920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4cbd92b963404a9f9c98ca34df3ba7)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:43.923007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:43.973552 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4cbd92b963404a9f9c98ca34df3ba7', 'request_id': 'req-929ed593-02ee-4201-8a15-bb6484bf0c3e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.980868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec71407-bcba-4287-ba94-0f1038b91826 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:43.981470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec71407-bcba-4287-ba94-0f1038b91826 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:43.981470 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec71407-bcba-4287-ba94-0f1038b91826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:43.986299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4cbd92b963404a9f9c98ca34df3ba7', 'request_id': 'req-929ed593-02ee-4201-8a15-bb6484bf0c3e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:43.992453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4cbd92b963404a9f9c98ca34df3ba7', 'request_id': 'req-929ed593-02ee-4201-8a15-bb6484bf0c3e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:44.005997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] The token cache is being invalidate because project 6c4cbd92b963404a9f9c98ca34df3ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:41:44.006300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:44.006967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-929ed593-02ee-4201-8a15-bb6484bf0c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:41:44.011858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1355/2687] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:41:43 2022] DELETE /identity/v3/projects/6c4cbd92b963404a9f9c98ca34df3ba7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:44.013519 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740243a2-a574-4ade-8893-6c5a1ec3d7cf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.013905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740243a2-a574-4ade-8893-6c5a1ec3d7cf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.014289 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740243a2-a574-4ade-8893-6c5a1ec3d7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.016072 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5ec71407-bcba-4287-ba94-0f1038b91826 None None] MFA Rules not processed for user `bfaad410ba79482f8caf3e0fde65b779`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:44.017316 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5ec71407-bcba-4287-ba94-0f1038b91826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:44.039215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-740243a2-a574-4ade-8893-6c5a1ec3d7cf None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:44.040931 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-740243a2-a574-4ade-8893-6c5a1ec3d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:44.113089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1333/2688] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:44.123751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3118d-9bdd-4508-ae05-926d21ebeee3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.124769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3118d-9bdd-4508-ae05-926d21ebeee3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.125151 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3118d-9bdd-4508-ae05-926d21ebeee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.127949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1356/2689] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:44.135909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55498-a279-4d91-add4-c7d1f81ba9e8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.136185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55498-a279-4d91-add4-c7d1f81ba9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.136467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55498-a279-4d91-add4-c7d1f81ba9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.152161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a9d3118d-9bdd-4508-ae05-926d21ebeee3 None None] MFA Rules not processed for user `e611e694efdc4714a4dde08d9a6d5577`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:44.153374 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a9d3118d-9bdd-4508-ae05-926d21ebeee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:44.159911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-faa55498-a279-4d91-add4-c7d1f81ba9e8 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:44.161091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-faa55498-a279-4d91-add4-c7d1f81ba9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:44.171842 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1357/2690] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:44.176155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa55498-a279-4d91-add4-c7d1f81ba9e8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:44.186775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa55498-a279-4d91-add4-c7d1f81ba9e8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:44.192510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716d311-70e1-4e0f-bf47-f22148f9542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:44.193126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d311-70e1-4e0f-bf47-f22148f9542c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.193428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d311-70e1-4e0f-bf47-f22148f9542c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.193645 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d311-70e1-4e0f-bf47-f22148f9542c admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.194320 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716d311-70e1-4e0f-bf47-f22148f9542c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:41:44.194613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716d311-70e1-4e0f-bf47-f22148f9542c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:44.196230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716d311-70e1-4e0f-bf47-f22148f9542c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:44.212028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1358/2691] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:41:44.213061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716d311-70e1-4e0f-bf47-f22148f9542c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:44.217786 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1334/2692] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:44.223737 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716d311-70e1-4e0f-bf47-f22148f9542c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:44.228376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c126-98d3-4b0d-951d-c9045aeb3b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:44.228898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3118d-9bdd-4508-ae05-926d21ebeee3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:44.229035 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c126-98d3-4b0d-951d-c9045aeb3b12 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.229264 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c126-98d3-4b0d-951d-c9045aeb3b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.229530 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c126-98d3-4b0d-951d-c9045aeb3b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.230171 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817c126-98d3-4b0d-951d-c9045aeb3b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:44.230321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a9d3118d-9bdd-4508-ae05-926d21ebeee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:44.232103 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817c126-98d3-4b0d-951d-c9045aeb3b12 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:44.262734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1359/2693] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:41:44 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:44.267150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c126-98d3-4b0d-951d-c9045aeb3b12 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:44.321078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:44.336065 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3118d-9bdd-4508-ae05-926d21ebeee3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:44.345288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c126-98d3-4b0d-951d-c9045aeb3b12 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:44.350821 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839471-9144-438b-ba4c-131658cc0f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:44.351715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839471-9144-438b-ba4c-131658cc0f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.351715 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839471-9144-438b-ba4c-131658cc0f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.352011 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839471-9144-438b-ba4c-131658cc0f05 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.352638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50839471-9144-438b-ba4c-131658cc0f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:44.354557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50839471-9144-438b-ba4c-131658cc0f05 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:44.367147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:44.380442 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1360/2694] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:41:44 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:41:44.384132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839471-9144-438b-ba4c-131658cc0f05 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:44.396835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839471-9144-438b-ba4c-131658cc0f05 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:44.402185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c038e1-e077-4cc3-b86c-5490a9e8ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:44.403359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c038e1-e077-4cc3-b86c-5490a9e8ef7a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.403644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c038e1-e077-4cc3-b86c-5490a9e8ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.403920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c038e1-e077-4cc3-b86c-5490a9e8ef7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.404580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c038e1-e077-4cc3-b86c-5490a9e8ef7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:44.406402 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c038e1-e077-4cc3-b86c-5490a9e8ef7a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:44.416086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f387ee-b17b-476a-a815-10cb485df0f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:44.416741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f387ee-b17b-476a-a815-10cb485df0f1 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.417079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f387ee-b17b-476a-a815-10cb485df0f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.417556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1361/2695] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:41:44.417701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f387ee-b17b-476a-a815-10cb485df0f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.421467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-25f387ee-b17b-476a-a815-10cb485df0f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:44.421750 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c038e1-e077-4cc3-b86c-5490a9e8ef7a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:44.438282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c038e1-e077-4cc3-b86c-5490a9e8ef7a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:44.443489 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733d6d-84b0-48bd-a50a-ca517106b88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:44.444893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733d6d-84b0-48bd-a50a-ca517106b88a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.445187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733d6d-84b0-48bd-a50a-ca517106b88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.445489 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733d6d-84b0-48bd-a50a-ca517106b88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.446304 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f733d6d-84b0-48bd-a50a-ca517106b88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:44.448652 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f733d6d-84b0-48bd-a50a-ca517106b88a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:44.467480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1362/2696] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:41:44.470015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733d6d-84b0-48bd-a50a-ca517106b88a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:44.484453 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733d6d-84b0-48bd-a50a-ca517106b88a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:44.490673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe0d0e-fc5c-4b51-b129-3bc93091bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:44.491377 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0d0e-fc5c-4b51-b129-3bc93091bbb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.491686 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0d0e-fc5c-4b51-b129-3bc93091bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.492475 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0d0e-fc5c-4b51-b129-3bc93091bbb8 admin admin] PATH_INFO: `/v3/projects/e093010ddbe1462eb95437810583faa9/users/df0e1ae1e1af4b60a97d993ba115d179/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.503671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f387ee-b17b-476a-a815-10cb485df0f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:44.506177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f387ee-b17b-476a-a815-10cb485df0f1 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:44.507498 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe0d0e-fc5c-4b51-b129-3bc93091bbb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e093010ddbe1462eb95437810583faa9, user_id=df0e1ae1e1af4b60a97d993ba115d179, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:44.510164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe0d0e-fc5c-4b51-b129-3bc93091bbb8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:44.516355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1335/2697] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:41:44.527677 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1363/2698] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:41:44 2022] PUT /identity/v3/projects/e093010ddbe1462eb95437810583faa9/users/df0e1ae1e1af4b60a97d993ba115d179/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:41:44.538027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82d5c7-773e-4fab-bc6f-6cbb5be62193 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.538435 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82d5c7-773e-4fab-bc6f-6cbb5be62193 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.538772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82d5c7-773e-4fab-bc6f-6cbb5be62193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.569992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-db82d5c7-773e-4fab-bc6f-6cbb5be62193 None None] MFA Rules not processed for user `df0e1ae1e1af4b60a97d993ba115d179`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:44.570939 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-db82d5c7-773e-4fab-bc6f-6cbb5be62193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:44.636622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1336/2699] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:41:44.649084 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe0d0e-fc5c-4b51-b129-3bc93091bbb8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:44.651070 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0bbe0d0e-fc5c-4b51-b129-3bc93091bbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:44.709757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe0d0e-fc5c-4b51-b129-3bc93091bbb8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:44.713524 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b3aa7-f823-4a14-ac7a-e9e27bf9bc30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '457880195ed849d2b594ddea6acdf7df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:44.714119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b3aa7-f823-4a14-ac7a-e9e27bf9bc30 service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:44.714391 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b3aa7-f823-4a14-ac7a-e9e27bf9bc30 service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:44.714666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b3aa7-f823-4a14-ac7a-e9e27bf9bc30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:44.723749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b3aa7-f823-4a14-ac7a-e9e27bf9bc30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:44.725185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b3aa7-f823-4a14-ac7a-e9e27bf9bc30 service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:44.734856 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1364/2700] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:41:46.809420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc2689-ad9d-4506-833f-75517e8f220c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:46.809925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc2689-ad9d-4506-833f-75517e8f220c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:46.810031 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc2689-ad9d-4506-833f-75517e8f220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:46.835579 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-90cc2689-ad9d-4506-833f-75517e8f220c None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:41:46.836997 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-90cc2689-ad9d-4506-833f-75517e8f220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:46.888328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:46.898220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1337/2701] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 6 04:41:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:41:46.911683 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b3aa7-f823-4a14-ac7a-e9e27bf9bc30 service glance] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:46.913117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0e7b3aa7-f823-4a14-ac7a-e9e27bf9bc30 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:46.986578 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b3aa7-f823-4a14-ac7a-e9e27bf9bc30 service glance] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:46.992543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3353a-c9df-495b-bfbc-eacf9f71394c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:46.993173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3353a-c9df-495b-bfbc-eacf9f71394c service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:46.993446 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3353a-c9df-495b-bfbc-eacf9f71394c service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:46.993710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3353a-c9df-495b-bfbc-eacf9f71394c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:41:47.002848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3353a-c9df-495b-bfbc-eacf9f71394c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:41:47.004444 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3353a-c9df-495b-bfbc-eacf9f71394c service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:41:47.012486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1365/2702] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:41:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:41:56.893081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:57.009200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:59.901643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc2689-ad9d-4506-833f-75517e8f220c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:41:59.903328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-90cc2689-ad9d-4506-833f-75517e8f220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:41:59.963536 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc2689-ad9d-4506-833f-75517e8f220c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:41:59.969111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31903338-647e-4c64-be8f-93dcc7106a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:41:59.970020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31903338-647e-4c64-be8f-93dcc7106a9a service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:41:59.970380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31903338-647e-4c64-be8f-93dcc7106a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:41:59.970723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31903338-647e-4c64-be8f-93dcc7106a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:00.042350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31903338-647e-4c64-be8f-93dcc7106a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:00.043834 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31903338-647e-4c64-be8f-93dcc7106a9a service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:00.053597 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1338/2703] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:41:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:10.049182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=50 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:10.888066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3353a-c9df-495b-bfbc-eacf9f71394c service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:10.953436 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3353a-c9df-495b-bfbc-eacf9f71394c service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:10.958153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:10.958784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:10.959049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:10.959327 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] PATH_INFO: `/v3/users/df0e1ae1e1af4b60a97d993ba115d179` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:10.960478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0e1ae1e1af4b60a97d993ba115d179)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:10.962376 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:11.009296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0e1ae1e1af4b60a97d993ba115d179'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:11.018016 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0e1ae1e1af4b60a97d993ba115d179'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:11.036835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0e1ae1e1af4b60a97d993ba115d179'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:11.037971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0e1ae1e1af4b60a97d993ba115d179'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:11.047031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0e1ae1e1af4b60a97d993ba115d179'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:11.055349 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1366/2704] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:42:10 2022] DELETE /identity/v3/users/df0e1ae1e1af4b60a97d993ba115d179 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:11.059865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68f69d-7e22-4c0d-b579-b02efb845e39 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:11.060348 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68f69d-7e22-4c0d-b579-b02efb845e39 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:11.060446 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68f69d-7e22-4c0d-b579-b02efb845e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:11.080415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5d68f69d-7e22-4c0d-b579-b02efb845e39 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:11.081682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5d68f69d-7e22-4c0d-b579-b02efb845e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:11.147111 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1339/2705] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:11.157556 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:11.159181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:11.225223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75548772-94f4-47fc-9672-9b36aba16561 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:11.229158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad18644-fedd-4248-bd25-7c6c00f1e991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:11.229768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad18644-fedd-4248-bd25-7c6c00f1e991 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:11.230065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad18644-fedd-4248-bd25-7c6c00f1e991 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:11.230334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad18644-fedd-4248-bd25-7c6c00f1e991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:11.240276 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad18644-fedd-4248-bd25-7c6c00f1e991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:11.241800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad18644-fedd-4248-bd25-7c6c00f1e991 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:11.252490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1367/2706] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:42:11.538029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68f69d-7e22-4c0d-b579-b02efb845e39 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:11.539711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5d68f69d-7e22-4c0d-b579-b02efb845e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:11.558875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68f69d-7e22-4c0d-b579-b02efb845e39 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:11.565179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:11.565946 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:11.566372 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:11.566699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] PATH_INFO: `/v3/projects/e093010ddbe1462eb95437810583faa9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:11.567932 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e093010ddbe1462eb95437810583faa9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:11.569839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:11.620816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e093010ddbe1462eb95437810583faa9', 'request_id': 'req-85004f7c-9304-4320-9e05-1c52233e9a0a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:11.629179 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e093010ddbe1462eb95437810583faa9', 'request_id': 'req-85004f7c-9304-4320-9e05-1c52233e9a0a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:11.634748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e093010ddbe1462eb95437810583faa9', 'request_id': 'req-85004f7c-9304-4320-9e05-1c52233e9a0a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:11.646073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] The token cache is being invalidate because project e093010ddbe1462eb95437810583faa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:42:11.646386 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:11.647053 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85004f7c-9304-4320-9e05-1c52233e9a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:11.648619 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1340/2707] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:42:11 2022] DELETE /identity/v3/projects/e093010ddbe1462eb95437810583faa9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:11.653640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3088d1d-3d5e-4f46-9959-0fccb92c075b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:11.653923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3088d1d-3d5e-4f46-9959-0fccb92c075b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:11.654193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3088d1d-3d5e-4f46-9959-0fccb92c075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:11.673964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d3088d1d-3d5e-4f46-9959-0fccb92c075b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:11.675081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d3088d1d-3d5e-4f46-9959-0fccb92c075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:11.700122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:11.748274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1368/2708] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:11.756333 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8308dae-114d-44ce-a012-80a7f062c92a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:11.756611 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8308dae-114d-44ce-a012-80a7f062c92a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:11.756875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8308dae-114d-44ce-a012-80a7f062c92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:11.776669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e8308dae-114d-44ce-a012-80a7f062c92a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:11.777859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e8308dae-114d-44ce-a012-80a7f062c92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:11.786339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1341/2709] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:11.790767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3088d1d-3d5e-4f46-9959-0fccb92c075b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:11.801206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3088d1d-3d5e-4f46-9959-0fccb92c075b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:11.806209 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b2052-2fec-4737-9c90-661dcded46a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:11.806820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b2052-2fec-4737-9c90-661dcded46a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:11.807091 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b2052-2fec-4737-9c90-661dcded46a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:11.807407 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b2052-2fec-4737-9c90-661dcded46a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:11.808061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b2052-2fec-4737-9c90-661dcded46a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:42:11.808362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b2052-2fec-4737-9c90-661dcded46a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:11.809953 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b2052-2fec-4737-9c90-661dcded46a5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:11.822744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1369/2710] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:42:11.827341 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8308dae-114d-44ce-a012-80a7f062c92a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:11.836687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8308dae-114d-44ce-a012-80a7f062c92a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:11.842355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04821d21-7560-40cd-933d-0450212110a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:11.842954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04821d21-7560-40cd-933d-0450212110a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:11.843224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04821d21-7560-40cd-933d-0450212110a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:11.843527 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04821d21-7560-40cd-933d-0450212110a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:11.844252 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04821d21-7560-40cd-933d-0450212110a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:11.846191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04821d21-7560-40cd-933d-0450212110a1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:11.876742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1342/2711] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:42:11 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:42:11.881380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b2052-2fec-4737-9c90-661dcded46a5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:11.891616 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b2052-2fec-4737-9c90-661dcded46a5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:11.953197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112973e8-5a76-40eb-a472-c9fb8dae44a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:11.953803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112973e8-5a76-40eb-a472-c9fb8dae44a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:11.954081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112973e8-5a76-40eb-a472-c9fb8dae44a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:11.954346 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112973e8-5a76-40eb-a472-c9fb8dae44a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:11.954970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112973e8-5a76-40eb-a472-c9fb8dae44a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:11.956909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112973e8-5a76-40eb-a472-c9fb8dae44a0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:11.980905 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1370/2712] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:42:11 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:42:11.985826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04821d21-7560-40cd-933d-0450212110a1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:11.996636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04821d21-7560-40cd-933d-0450212110a1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:12.001615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2aace-eaac-4a21-bfb1-24b3a44e567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:12.002213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2aace-eaac-4a21-bfb1-24b3a44e567d admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:12.002490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2aace-eaac-4a21-bfb1-24b3a44e567d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:12.002760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2aace-eaac-4a21-bfb1-24b3a44e567d admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:12.003444 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2aace-eaac-4a21-bfb1-24b3a44e567d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:12.005058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2aace-eaac-4a21-bfb1-24b3a44e567d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:12.014830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1343/2713] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:12.018869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112973e8-5a76-40eb-a472-c9fb8dae44a0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:12.029359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112973e8-5a76-40eb-a472-c9fb8dae44a0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:12.034884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d834dc1-988e-4972-a63a-bc869d4f18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:12.035531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d834dc1-988e-4972-a63a-bc869d4f18be admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:12.035806 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d834dc1-988e-4972-a63a-bc869d4f18be admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:12.036075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d834dc1-988e-4972-a63a-bc869d4f18be admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:12.036724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d834dc1-988e-4972-a63a-bc869d4f18be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:12.038334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d834dc1-988e-4972-a63a-bc869d4f18be admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:12.049978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1371/2714] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:12.054447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2aace-eaac-4a21-bfb1-24b3a44e567d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:12.066016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2aace-eaac-4a21-bfb1-24b3a44e567d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:12.072382 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cfba4-d163-42b9-ba4d-25619ca40eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:12.073033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cfba4-d163-42b9-ba4d-25619ca40eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:12.073307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cfba4-d163-42b9-ba4d-25619ca40eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:12.073573 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cfba4-d163-42b9-ba4d-25619ca40eaf admin admin] PATH_INFO: `/v3/projects/6cf243cf66c346c4843d3b7beb3a1ddd/users/5730e60637584aa5a2665a9107922978/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:12.088614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cfba4-d163-42b9-ba4d-25619ca40eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf243cf66c346c4843d3b7beb3a1ddd, user_id=5730e60637584aa5a2665a9107922978, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:12.091282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cfba4-d163-42b9-ba4d-25619ca40eaf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:12.105666 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1344/2715] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:42:12 2022] PUT /identity/v3/projects/6cf243cf66c346c4843d3b7beb3a1ddd/users/5730e60637584aa5a2665a9107922978/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:12.112845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5703a-cdc0-4298-9199-b325f1903c9e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:12.113167 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5703a-cdc0-4298-9199-b325f1903c9e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:12.113478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5703a-cdc0-4298-9199-b325f1903c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:12.142116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f8e5703a-cdc0-4298-9199-b325f1903c9e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:12.143347 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f8e5703a-cdc0-4298-9199-b325f1903c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:12.212972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1372/2716] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:12.220683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cfba4-d163-42b9-ba4d-25619ca40eaf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:12.222572 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-659cfba4-d163-42b9-ba4d-25619ca40eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:12.247450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:12.285670 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cfba4-d163-42b9-ba4d-25619ca40eaf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:12.290001 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80559f5e-2746-4fd3-b950-33deb52ac114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:12.290615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80559f5e-2746-4fd3-b950-33deb52ac114 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:12.290893 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80559f5e-2746-4fd3-b950-33deb52ac114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:12.291155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80559f5e-2746-4fd3-b950-33deb52ac114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:12.302652 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80559f5e-2746-4fd3-b950-33deb52ac114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:12.307349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80559f5e-2746-4fd3-b950-33deb52ac114 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:12.318658 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1345/2717] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:16.408490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204db49-d5cf-40e9-b7c0-b3850f8b10b1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:16.409031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204db49-d5cf-40e9-b7c0-b3850f8b10b1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:16.409216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204db49-d5cf-40e9-b7c0-b3850f8b10b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:16.453840 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5204db49-d5cf-40e9-b7c0-b3850f8b10b1 None None] MFA Rules not processed for user `5730e60637584aa5a2665a9107922978`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:16.455262 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5204db49-d5cf-40e9-b7c0-b3850f8b10b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:16.482749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:16.566770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1373/2718] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:42:16.571796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80559f5e-2746-4fd3-b950-33deb52ac114 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:16.588890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80559f5e-2746-4fd3-b950-33deb52ac114 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:16.594982 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801aac-d437-4d48-b3fc-9f5e145c3ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:16.596047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801aac-d437-4d48-b3fc-9f5e145c3ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:16.596549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801aac-d437-4d48-b3fc-9f5e145c3ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:16.597819 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801aac-d437-4d48-b3fc-9f5e145c3ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:16.599529 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801aac-d437-4d48-b3fc-9f5e145c3ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:16.602172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801aac-d437-4d48-b3fc-9f5e145c3ca4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:16.635943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1346/2719] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:42:16 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:42:16.640387 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204db49-d5cf-40e9-b7c0-b3850f8b10b1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:16.652823 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204db49-d5cf-40e9-b7c0-b3850f8b10b1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:16.738652 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca71300-44d4-40c4-8e23-e53ad2585427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:16.741030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca71300-44d4-40c4-8e23-e53ad2585427 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:16.741030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca71300-44d4-40c4-8e23-e53ad2585427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:16.741030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca71300-44d4-40c4-8e23-e53ad2585427 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:16.741030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca71300-44d4-40c4-8e23-e53ad2585427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:16.744509 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca71300-44d4-40c4-8e23-e53ad2585427 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:16.775858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1374/2720] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:42:16 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:42:16.779719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801aac-d437-4d48-b3fc-9f5e145c3ca4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:16.790788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801aac-d437-4d48-b3fc-9f5e145c3ca4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:16.796008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1456d-20a1-43ec-a645-890715040f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:16.796681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1456d-20a1-43ec-a645-890715040f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:16.797057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1456d-20a1-43ec-a645-890715040f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:16.797375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1456d-20a1-43ec-a645-890715040f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:16.798074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1456d-20a1-43ec-a645-890715040f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:16.800589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1456d-20a1-43ec-a645-890715040f4f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:16.812916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1347/2721] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:42:16.818105 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca71300-44d4-40c4-8e23-e53ad2585427 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:16.833410 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca71300-44d4-40c4-8e23-e53ad2585427 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:16.839718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6ac7e-0b48-4ea5-9a25-192ff5e199bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:16.840360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6ac7e-0b48-4ea5-9a25-192ff5e199bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:16.840602 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6ac7e-0b48-4ea5-9a25-192ff5e199bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:16.840862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6ac7e-0b48-4ea5-9a25-192ff5e199bd admin admin] PATH_INFO: `/v3/projects/373207b07bb24927a6379334b344ad17/users/83bac4a40715415fb547d34d9bfae964/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:16.858922 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6ac7e-0b48-4ea5-9a25-192ff5e199bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=373207b07bb24927a6379334b344ad17, user_id=83bac4a40715415fb547d34d9bfae964, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:16.862122 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6ac7e-0b48-4ea5-9a25-192ff5e199bd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:16.880514 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1375/2722] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:42:16 2022] PUT /identity/v3/projects/373207b07bb24927a6379334b344ad17/users/83bac4a40715415fb547d34d9bfae964/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:16.884687 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1456d-20a1-43ec-a645-890715040f4f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:16.896345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1456d-20a1-43ec-a645-890715040f4f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:16.964502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc8948-a0c9-4d8c-8f04-0e6c46b70128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:16.965174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc8948-a0c9-4d8c-8f04-0e6c46b70128 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:16.965667 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc8948-a0c9-4d8c-8f04-0e6c46b70128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:16.965936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc8948-a0c9-4d8c-8f04-0e6c46b70128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:16.966609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc8948-a0c9-4d8c-8f04-0e6c46b70128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:16.968292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc8948-a0c9-4d8c-8f04-0e6c46b70128 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:16.981009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1348/2723] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:42:16.985579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6ac7e-0b48-4ea5-9a25-192ff5e199bd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:17.004879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6ac7e-0b48-4ea5-9a25-192ff5e199bd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:17.010172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062a95a-ee4b-41c6-93a9-51f77c36bced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:17.010882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062a95a-ee4b-41c6-93a9-51f77c36bced admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:17.011156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062a95a-ee4b-41c6-93a9-51f77c36bced admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:17.011449 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062a95a-ee4b-41c6-93a9-51f77c36bced admin admin] PATH_INFO: `/v3/projects/373207b07bb24927a6379334b344ad17/users/83bac4a40715415fb547d34d9bfae964/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:17.013522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062a95a-ee4b-41c6-93a9-51f77c36bced admin admin] RBAC: Authorizing `identity:create_grant(project_id=373207b07bb24927a6379334b344ad17, user_id=83bac4a40715415fb547d34d9bfae964, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:17.016427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062a95a-ee4b-41c6-93a9-51f77c36bced admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:17.031536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1376/2724] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:42:16 2022] PUT /identity/v3/projects/373207b07bb24927a6379334b344ad17/users/83bac4a40715415fb547d34d9bfae964/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:20.853494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc8948-a0c9-4d8c-8f04-0e6c46b70128 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:20.855568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4cbc8948-a0c9-4d8c-8f04-0e6c46b70128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:20.881109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc8948-a0c9-4d8c-8f04-0e6c46b70128 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:20.975484 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:20.976227 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:20.976743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:20.977082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] PATH_INFO: `/v3/users/e611e694efdc4714a4dde08d9a6d5577` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:20.978517 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e611e694efdc4714a4dde08d9a6d5577)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:20.983237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:21.042514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:21.077655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e611e694efdc4714a4dde08d9a6d5577'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.078402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e611e694efdc4714a4dde08d9a6d5577'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.092882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e611e694efdc4714a4dde08d9a6d5577'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.113625 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e611e694efdc4714a4dde08d9a6d5577'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.128739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e611e694efdc4714a4dde08d9a6d5577'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.150554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1349/2725] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:42:20 2022] DELETE /identity/v3/users/e611e694efdc4714a4dde08d9a6d5577 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:21.400507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062a95a-ee4b-41c6-93a9-51f77c36bced admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:21.402809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4062a95a-ee4b-41c6-93a9-51f77c36bced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:21.419478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062a95a-ee4b-41c6-93a9-51f77c36bced admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:21.530126 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:21.530790 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:21.531474 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:21.532307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] PATH_INFO: `/v3/projects/177597d3048840fba33ef780551d929c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:21.534153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177597d3048840fba33ef780551d929c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:21.536752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:21.551669 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:21.611368 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177597d3048840fba33ef780551d929c', 'request_id': 'req-8c3817d5-d54c-4057-bf8c-8f217c6aa552'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.630685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177597d3048840fba33ef780551d929c', 'request_id': 'req-8c3817d5-d54c-4057-bf8c-8f217c6aa552'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.639052 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177597d3048840fba33ef780551d929c', 'request_id': 'req-8c3817d5-d54c-4057-bf8c-8f217c6aa552'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.664168 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] The token cache is being invalidate because project 177597d3048840fba33ef780551d929c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:42:21.664603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.665361 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8c3817d5-d54c-4057-bf8c-8f217c6aa552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.667300 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1377/2726] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:42:21 2022] DELETE /identity/v3/projects/177597d3048840fba33ef780551d929c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:21.671490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:21.684801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180b11e-e051-4b57-8c00-9c42ff3010bc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:21.771794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:21.773020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:21.773231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:21.773599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] PATH_INFO: `/v3/users/bfaad410ba79482f8caf3e0fde65b779` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:21.774879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfaad410ba79482f8caf3e0fde65b779)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:21.777056 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:21.851474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfaad410ba79482f8caf3e0fde65b779'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.852621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfaad410ba79482f8caf3e0fde65b779'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.863342 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05037dac-ee8d-4dea-9bdb-34da547b7f59 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:21.863639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05037dac-ee8d-4dea-9bdb-34da547b7f59 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:21.863910 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05037dac-ee8d-4dea-9bdb-34da547b7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:21.871410 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfaad410ba79482f8caf3e0fde65b779'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.884102 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfaad410ba79482f8caf3e0fde65b779'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.892203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfaad410ba79482f8caf3e0fde65b779'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:21.899681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1350/2727] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:42:21 2022] DELETE /identity/v3/users/bfaad410ba79482f8caf3e0fde65b779 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:21.920079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-05037dac-ee8d-4dea-9bdb-34da547b7f59 None None] MFA Rules not processed for user `83bac4a40715415fb547d34d9bfae964`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:21.921371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-05037dac-ee8d-4dea-9bdb-34da547b7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:22.023116 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1378/2728] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:22.036723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:22.038659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:22.080284 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:22.122295 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daefbf-0e8b-40ad-8a41-c13e64e7219b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:22.127019 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37147e-fb7e-4c72-a414-ee3a1a67b2a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '457880195ed849d2b594ddea6acdf7df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:22.127899 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37147e-fb7e-4c72-a414-ee3a1a67b2a8 service glance] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.128154 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37147e-fb7e-4c72-a414-ee3a1a67b2a8 service glance] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.128422 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37147e-fb7e-4c72-a414-ee3a1a67b2a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.130538 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fa37147e-fb7e-4c72-a414-ee3a1a67b2a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:22.146662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05037dac-ee8d-4dea-9bdb-34da547b7f59 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:22.148364 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-05037dac-ee8d-4dea-9bdb-34da547b7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:22.269405 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05037dac-ee8d-4dea-9bdb-34da547b7f59 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:22.272476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37147e-fb7e-4c72-a414-ee3a1a67b2a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:22.273938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37147e-fb7e-4c72-a414-ee3a1a67b2a8 service glance] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:22.274954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:22.275723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.276001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.276268 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] PATH_INFO: `/v3/projects/04899e14c1d54a46a91fa4efa1ddbd00` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.277670 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] RBAC: Authorizing `identity:delete_project(project_id=04899e14c1d54a46a91fa4efa1ddbd00)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:22.279723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:22.284335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1351/2729] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:22.334685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:22.351770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04899e14c1d54a46a91fa4efa1ddbd00', 'request_id': 'req-5164ebe7-0122-4094-9962-37bf64d8a76c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:22.363242 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04899e14c1d54a46a91fa4efa1ddbd00', 'request_id': 'req-5164ebe7-0122-4094-9962-37bf64d8a76c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:22.370270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04899e14c1d54a46a91fa4efa1ddbd00', 'request_id': 'req-5164ebe7-0122-4094-9962-37bf64d8a76c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:22.390516 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] The token cache is being invalidate because project 04899e14c1d54a46a91fa4efa1ddbd00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:42:22.390995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:22.391695 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5164ebe7-0122-4094-9962-37bf64d8a76c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:22.393750 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1379/2730] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:42:22 2022] DELETE /identity/v3/projects/04899e14c1d54a46a91fa4efa1ddbd00 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:42:22.398636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6cc9-942d-475b-bbdf-e1db8f4784ed None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.398902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6cc9-942d-475b-bbdf-e1db8f4784ed None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.399253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6cc9-942d-475b-bbdf-e1db8f4784ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.426491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7d6e6cc9-942d-475b-bbdf-e1db8f4784ed None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:22.428526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7d6e6cc9-942d-475b-bbdf-e1db8f4784ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:22.443235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b1403-4221-48cc-9aea-953064bf5cff None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.443797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b1403-4221-48cc-9aea-953064bf5cff None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.443797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b1403-4221-48cc-9aea-953064bf5cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.467072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-289b1403-4221-48cc-9aea-953064bf5cff None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:22.468339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-289b1403-4221-48cc-9aea-953064bf5cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:22.500454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1352/2731] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:22.508224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f91f-1171-47ef-a3d3-9d2c9da921d3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.508532 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f91f-1171-47ef-a3d3-9d2c9da921d3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.508815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f91f-1171-47ef-a3d3-9d2c9da921d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.529836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5651f91f-1171-47ef-a3d3-9d2c9da921d3 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:22.531128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5651f91f-1171-47ef-a3d3-9d2c9da921d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:22.538222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1380/2732] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:42:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:42:22.543498 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1353/2733] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:42:22.545274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b1403-4221-48cc-9aea-953064bf5cff None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:22.560642 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b1403-4221-48cc-9aea-953064bf5cff None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:22.563782 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f91f-1171-47ef-a3d3-9d2c9da921d3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:22.565566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5651f91f-1171-47ef-a3d3-9d2c9da921d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:22.567857 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266819aa-f316-45ef-b32a-5264f94b7a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:22.568655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266819aa-f316-45ef-b32a-5264f94b7a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.569163 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266819aa-f316-45ef-b32a-5264f94b7a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.569370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266819aa-f316-45ef-b32a-5264f94b7a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.570817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266819aa-f316-45ef-b32a-5264f94b7a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:42:22.570817 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266819aa-f316-45ef-b32a-5264f94b7a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:22.572581 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266819aa-f316-45ef-b32a-5264f94b7a9a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:22.587002 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1381/2734] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:42:22.591340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266819aa-f316-45ef-b32a-5264f94b7a9a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:22.601465 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266819aa-f316-45ef-b32a-5264f94b7a9a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:22.606132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c59531-1dc2-457e-b69a-a6cefb6d19cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:22.606740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c59531-1dc2-457e-b69a-a6cefb6d19cc admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.607012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c59531-1dc2-457e-b69a-a6cefb6d19cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.607400 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c59531-1dc2-457e-b69a-a6cefb6d19cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.608006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c59531-1dc2-457e-b69a-a6cefb6d19cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:22.611000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c59531-1dc2-457e-b69a-a6cefb6d19cc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:22.650863 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1382/2735] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:42:22 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:42:22.651200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f91f-1171-47ef-a3d3-9d2c9da921d3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:22.653320 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c59531-1dc2-457e-b69a-a6cefb6d19cc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:22.669138 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:22.721803 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6e206-8905-454c-9070-fb34c8c3f146 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:22.722466 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6e206-8905-454c-9070-fb34c8c3f146 service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.722737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6e206-8905-454c-9070-fb34c8c3f146 service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.722885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c59531-1dc2-457e-b69a-a6cefb6d19cc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:22.723036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6e206-8905-454c-9070-fb34c8c3f146 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.727688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc59874-67ed-48fc-8cd4-2c91ee042bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:22.728294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59874-67ed-48fc-8cd4-2c91ee042bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.728568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59874-67ed-48fc-8cd4-2c91ee042bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.728840 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59874-67ed-48fc-8cd4-2c91ee042bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.729469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc59874-67ed-48fc-8cd4-2c91ee042bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:22.731437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc59874-67ed-48fc-8cd4-2c91ee042bc7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:22.754200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1383/2736] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:42:22 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:42:22.758286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc59874-67ed-48fc-8cd4-2c91ee042bc7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:22.768512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc59874-67ed-48fc-8cd4-2c91ee042bc7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:22.774174 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cb523-a392-412c-90d0-2c9108c0dc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:22.774780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cb523-a392-412c-90d0-2c9108c0dc79 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.775047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cb523-a392-412c-90d0-2c9108c0dc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.775340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cb523-a392-412c-90d0-2c9108c0dc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.775981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cb523-a392-412c-90d0-2c9108c0dc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:22.777554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cb523-a392-412c-90d0-2c9108c0dc79 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:22.783922 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6e206-8905-454c-9070-fb34c8c3f146 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:22.785660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6e206-8905-454c-9070-fb34c8c3f146 service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:22.787993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1384/2737] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:22.791723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cb523-a392-412c-90d0-2c9108c0dc79 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:22.794471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1354/2738] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:42:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:42:22.798137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:22.802326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cb523-a392-412c-90d0-2c9108c0dc79 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:22.808558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7cc23-d568-4593-921a-1692dc3a3dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:22.809339 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7cc23-d568-4593-921a-1692dc3a3dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.809971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7cc23-d568-4593-921a-1692dc3a3dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.810464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7cc23-d568-4593-921a-1692dc3a3dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.811430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7cc23-d568-4593-921a-1692dc3a3dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:22.813015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7cc23-d568-4593-921a-1692dc3a3dbe admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:22.827619 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1385/2739] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:22.830845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6e206-8905-454c-9070-fb34c8c3f146 service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:22.843449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6e206-8905-454c-9070-fb34c8c3f146 service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:22.848229 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6e4b4-3cf6-4ba7-b4ce-31916e566dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:22.849020 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6e4b4-3cf6-4ba7-b4ce-31916e566dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.849739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6e4b4-3cf6-4ba7-b4ce-31916e566dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.849739 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6e4b4-3cf6-4ba7-b4ce-31916e566dbf admin admin] PATH_INFO: `/v3/projects/5733202422544a8f834ec94edca6ab2a/users/09b116e82d5949b08b183dfc9cc942b8/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.868318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6e4b4-3cf6-4ba7-b4ce-31916e566dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5733202422544a8f834ec94edca6ab2a, user_id=09b116e82d5949b08b183dfc9cc942b8, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:22.870971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6e4b4-3cf6-4ba7-b4ce-31916e566dbf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:22.904732 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1355/2740] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:42:22 2022] PUT /identity/v3/projects/5733202422544a8f834ec94edca6ab2a/users/09b116e82d5949b08b183dfc9cc942b8/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:42:22.908884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556b0d2-c5d6-40fd-97e4-99ac6cb1c6c0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:22.908884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556b0d2-c5d6-40fd-97e4-99ac6cb1c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:22.908884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556b0d2-c5d6-40fd-97e4-99ac6cb1c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:22.941679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1556b0d2-c5d6-40fd-97e4-99ac6cb1c6c0 None None] MFA Rules not processed for user `09b116e82d5949b08b183dfc9cc942b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:22.942907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1556b0d2-c5d6-40fd-97e4-99ac6cb1c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:23.024250 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1386/2741] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:23.048566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6e4b4-3cf6-4ba7-b4ce-31916e566dbf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:23.056355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-30f6e4b4-3cf6-4ba7-b4ce-31916e566dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:23.124609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6e4b4-3cf6-4ba7-b4ce-31916e566dbf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:23.128401 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6c384-aac6-4751-ada3-deb7ed4a02b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:23.129131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c384-aac6-4751-ada3-deb7ed4a02b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:23.130450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c384-aac6-4751-ada3-deb7ed4a02b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:23.130450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c384-aac6-4751-ada3-deb7ed4a02b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:23.140249 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6c384-aac6-4751-ada3-deb7ed4a02b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:23.141904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6c384-aac6-4751-ada3-deb7ed4a02b6 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:23.154141 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1356/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:23.175439 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556b0d2-c5d6-40fd-97e4-99ac6cb1c6c0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:23.296492 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556b0d2-c5d6-40fd-97e4-99ac6cb1c6c0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:23.303039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:23.308789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:23.308789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:23.308789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] PATH_INFO: `/v3/users/09b116e82d5949b08b183dfc9cc942b8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:23.308789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b116e82d5949b08b183dfc9cc942b8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:23.308789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:23.387820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b116e82d5949b08b183dfc9cc942b8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:23.399684 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b116e82d5949b08b183dfc9cc942b8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:23.416727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b116e82d5949b08b183dfc9cc942b8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:23.417486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b116e82d5949b08b183dfc9cc942b8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:23.439656 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b116e82d5949b08b183dfc9cc942b8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:23.452806 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23613e-cbb5-4d37-a9b1-1807c26f56c6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:23.453192 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23613e-cbb5-4d37-a9b1-1807c26f56c6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:23.453467 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23613e-cbb5-4d37-a9b1-1807c26f56c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:23.457950 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1387/2743] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:42:23 2022] DELETE /identity/v3/users/09b116e82d5949b08b183dfc9cc942b8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:23.494945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2c23613e-cbb5-4d37-a9b1-1807c26f56c6 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:23.499634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2c23613e-cbb5-4d37-a9b1-1807c26f56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:23.550660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:23.595544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1357/2744] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:23.603834 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:23.608850 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:23.615294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:23.725205 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127b558-0027-4ddb-9bc6-a7ac6d19930f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:23.730039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15529-46b7-42de-9192-615b4c7ec5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:23.730911 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15529-46b7-42de-9192-615b4c7ec5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:23.731243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15529-46b7-42de-9192-615b4c7ec5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:23.731674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15529-46b7-42de-9192-615b4c7ec5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:23.745411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c15529-46b7-42de-9192-615b4c7ec5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:23.746933 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c15529-46b7-42de-9192-615b4c7ec5f8 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:23.764015 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1388/2745] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:24.182517 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23613e-cbb5-4d37-a9b1-1807c26f56c6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:24.184079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2c23613e-cbb5-4d37-a9b1-1807c26f56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:24.200745 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23613e-cbb5-4d37-a9b1-1807c26f56c6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:24.209008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:24.210268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:24.210830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:24.211255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] PATH_INFO: `/v3/projects/5733202422544a8f834ec94edca6ab2a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:24.212659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5733202422544a8f834ec94edca6ab2a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:24.215506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:24.283207 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5733202422544a8f834ec94edca6ab2a', 'request_id': 'req-33688034-b45f-4927-8363-a2bd4ed8a39b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:24.294541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5733202422544a8f834ec94edca6ab2a', 'request_id': 'req-33688034-b45f-4927-8363-a2bd4ed8a39b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:24.302472 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5733202422544a8f834ec94edca6ab2a', 'request_id': 'req-33688034-b45f-4927-8363-a2bd4ed8a39b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:24.321980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] The token cache is being invalidate because project 5733202422544a8f834ec94edca6ab2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:42:24.322550 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:24.323512 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-33688034-b45f-4927-8363-a2bd4ed8a39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:24.325420 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1358/2746] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:42:24 2022] DELETE /identity/v3/projects/5733202422544a8f834ec94edca6ab2a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:24.330797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de856f8-b3bd-4252-a515-7117ccb0eaea None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:24.331353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de856f8-b3bd-4252-a515-7117ccb0eaea None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:24.331725 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de856f8-b3bd-4252-a515-7117ccb0eaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:24.356687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9de856f8-b3bd-4252-a515-7117ccb0eaea None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:24.358082 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9de856f8-b3bd-4252-a515-7117ccb0eaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:24.433891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1389/2747] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:42:24.443801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee40c5b-759d-4411-b6a5-aa811f2b727b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:24.444505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee40c5b-759d-4411-b6a5-aa811f2b727b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:24.444505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee40c5b-759d-4411-b6a5-aa811f2b727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:24.466107 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6ee40c5b-759d-4411-b6a5-aa811f2b727b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:24.468174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6ee40c5b-759d-4411-b6a5-aa811f2b727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:24.477514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1359/2748] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:24.482224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de856f8-b3bd-4252-a515-7117ccb0eaea None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:24.493727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de856f8-b3bd-4252-a515-7117ccb0eaea None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:24.500837 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01d62-10ee-479f-a90e-e823bc6b335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:24.501651 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01d62-10ee-479f-a90e-e823bc6b335a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:24.501935 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01d62-10ee-479f-a90e-e823bc6b335a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:24.502206 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01d62-10ee-479f-a90e-e823bc6b335a admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:24.502872 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e01d62-10ee-479f-a90e-e823bc6b335a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:42:24.503173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e01d62-10ee-479f-a90e-e823bc6b335a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:24.504807 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e01d62-10ee-479f-a90e-e823bc6b335a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:24.518097 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1390/2749] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:42:24.522480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee40c5b-759d-4411-b6a5-aa811f2b727b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:24.533007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee40c5b-759d-4411-b6a5-aa811f2b727b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:24.540835 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdb152-e15c-48c6-8ef3-517432c95637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:24.541475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdb152-e15c-48c6-8ef3-517432c95637 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:24.541743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdb152-e15c-48c6-8ef3-517432c95637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:24.542013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdb152-e15c-48c6-8ef3-517432c95637 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:24.542673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdb152-e15c-48c6-8ef3-517432c95637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:24.544636 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdb152-e15c-48c6-8ef3-517432c95637 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:24.585868 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1360/2750] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:42:24 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:42:24.587036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01d62-10ee-479f-a90e-e823bc6b335a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:24.601360 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01d62-10ee-479f-a90e-e823bc6b335a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:24.666990 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e1560-136f-490f-bff0-42718fe54cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:24.667995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e1560-136f-490f-bff0-42718fe54cbb admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:24.668457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e1560-136f-490f-bff0-42718fe54cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:24.668915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e1560-136f-490f-bff0-42718fe54cbb admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:24.669580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e1560-136f-490f-bff0-42718fe54cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:24.671599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e1560-136f-490f-bff0-42718fe54cbb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:24.699881 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1391/2751] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:42:24 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:42:24.704160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdb152-e15c-48c6-8ef3-517432c95637 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:24.718844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdb152-e15c-48c6-8ef3-517432c95637 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:24.726463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecb8a3-8d19-4fc7-8013-726ff59fca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:24.727195 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecb8a3-8d19-4fc7-8013-726ff59fca41 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:24.727614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecb8a3-8d19-4fc7-8013-726ff59fca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:24.727952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecb8a3-8d19-4fc7-8013-726ff59fca41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:24.728696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecb8a3-8d19-4fc7-8013-726ff59fca41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:24.730475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecb8a3-8d19-4fc7-8013-726ff59fca41 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:24.742645 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1361/2752] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:24.747253 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e1560-136f-490f-bff0-42718fe54cbb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:24.760941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e1560-136f-490f-bff0-42718fe54cbb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:24.766557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46feafa-5b50-4f17-b3bd-32c981ed8b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:24.767181 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46feafa-5b50-4f17-b3bd-32c981ed8b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:24.767486 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46feafa-5b50-4f17-b3bd-32c981ed8b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:24.767759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46feafa-5b50-4f17-b3bd-32c981ed8b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:24.768409 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46feafa-5b50-4f17-b3bd-32c981ed8b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:24.770075 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46feafa-5b50-4f17-b3bd-32c981ed8b66 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:24.788060 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1392/2753] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:24.789364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecb8a3-8d19-4fc7-8013-726ff59fca41 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:24.802224 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecb8a3-8d19-4fc7-8013-726ff59fca41 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:24.806853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82cc9b-c763-4ab4-8e71-49263fc81c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:24.807654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82cc9b-c763-4ab4-8e71-49263fc81c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:24.807931 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82cc9b-c763-4ab4-8e71-49263fc81c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:24.808204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82cc9b-c763-4ab4-8e71-49263fc81c61 admin admin] PATH_INFO: `/v3/projects/a0e3c0d53c9246d1a21e98264715bf30/users/0d8edfef87554935a1f41d7998bfccb3/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:24.825251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82cc9b-c763-4ab4-8e71-49263fc81c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e3c0d53c9246d1a21e98264715bf30, user_id=0d8edfef87554935a1f41d7998bfccb3, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:24.828029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82cc9b-c763-4ab4-8e71-49263fc81c61 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:24.851566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1362/2754] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:42:24 2022] PUT /identity/v3/projects/a0e3c0d53c9246d1a21e98264715bf30/users/0d8edfef87554935a1f41d7998bfccb3/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:24.862669 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0ccd-64dc-4900-8902-59b03f1cda76 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:24.863467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0ccd-64dc-4900-8902-59b03f1cda76 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:24.863467 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0ccd-64dc-4900-8902-59b03f1cda76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:24.894727 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:24.907033 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e94a0ccd-64dc-4900-8902-59b03f1cda76 None None] MFA Rules not processed for user `0d8edfef87554935a1f41d7998bfccb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:24.908897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e94a0ccd-64dc-4900-8902-59b03f1cda76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:24.990983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1393/2755] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:25.002427 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82cc9b-c763-4ab4-8e71-49263fc81c61 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:25.004691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0d82cc9b-c763-4ab4-8e71-49263fc81c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:25.097286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82cc9b-c763-4ab4-8e71-49263fc81c61 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:25.104694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87160f-9f77-4d01-9a21-b90593dac50b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:25.105331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87160f-9f77-4d01-9a21-b90593dac50b service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:25.105609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87160f-9f77-4d01-9a21-b90593dac50b service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:25.105913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87160f-9f77-4d01-9a21-b90593dac50b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:25.118609 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87160f-9f77-4d01-9a21-b90593dac50b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:25.120762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87160f-9f77-4d01-9a21-b90593dac50b service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:25.125708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:25.146568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1363/2756] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:30.832071 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0ccd-64dc-4900-8902-59b03f1cda76 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:30.910222 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0ccd-64dc-4900-8902-59b03f1cda76 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:30.914858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:30.915553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:30.915824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:30.916093 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] PATH_INFO: `/v3/users/0d8edfef87554935a1f41d7998bfccb3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:30.917282 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8edfef87554935a1f41d7998bfccb3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:30.919197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:30.976036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8edfef87554935a1f41d7998bfccb3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:30.986170 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8edfef87554935a1f41d7998bfccb3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:31.000644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8edfef87554935a1f41d7998bfccb3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:31.001399 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8edfef87554935a1f41d7998bfccb3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:31.009491 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8edfef87554935a1f41d7998bfccb3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:31.016418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1394/2757] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:42:30 2022] DELETE /identity/v3/users/0d8edfef87554935a1f41d7998bfccb3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:31.021256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633881-b172-43da-b05b-f2d213a192e2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:31.021725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633881-b172-43da-b05b-f2d213a192e2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:31.021857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633881-b172-43da-b05b-f2d213a192e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:31.044955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b5633881-b172-43da-b05b-f2d213a192e2 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:31.048151 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b5633881-b172-43da-b05b-f2d213a192e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:31.120183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1364/2758] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:31.131497 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:31.133041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:31.159663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:31.201437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ccfe5-7ffa-4af4-bc09-5a5955a75d0f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:31.205869 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41c342-773a-40fb-a6ed-bd29970e2776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:31.206702 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c342-773a-40fb-a6ed-bd29970e2776 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:31.206976 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c342-773a-40fb-a6ed-bd29970e2776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:31.207267 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c342-773a-40fb-a6ed-bd29970e2776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:31.217214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41c342-773a-40fb-a6ed-bd29970e2776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:31.218728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41c342-773a-40fb-a6ed-bd29970e2776 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:31.230266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1395/2759] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:42:31.562533 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5633881-b172-43da-b05b-f2d213a192e2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:31.564446 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b5633881-b172-43da-b05b-f2d213a192e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:31.576780 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5633881-b172-43da-b05b-f2d213a192e2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:31.586601 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:31.587257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:31.587564 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:31.587827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] PATH_INFO: `/v3/projects/a0e3c0d53c9246d1a21e98264715bf30` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:31.588955 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e3c0d53c9246d1a21e98264715bf30)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:31.590878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:31.650794 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e3c0d53c9246d1a21e98264715bf30', 'request_id': 'req-14e4aac5-6244-496c-90cb-de4cc0015c4e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:31.660447 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e3c0d53c9246d1a21e98264715bf30', 'request_id': 'req-14e4aac5-6244-496c-90cb-de4cc0015c4e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:31.666554 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e3c0d53c9246d1a21e98264715bf30', 'request_id': 'req-14e4aac5-6244-496c-90cb-de4cc0015c4e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:31.680212 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] The token cache is being invalidate because project a0e3c0d53c9246d1a21e98264715bf30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:42:31.680634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:31.681364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14e4aac5-6244-496c-90cb-de4cc0015c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:31.682935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1365/2760] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:42:31 2022] DELETE /identity/v3/projects/a0e3c0d53c9246d1a21e98264715bf30 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:31.688531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133aace-98e9-4b7c-b993-2bccda7a745c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:31.689047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133aace-98e9-4b7c-b993-2bccda7a745c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:31.689332 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133aace-98e9-4b7c-b993-2bccda7a745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:31.714729 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b133aace-98e9-4b7c-b993-2bccda7a745c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:31.716216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b133aace-98e9-4b7c-b993-2bccda7a745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:31.798561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1396/2761] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:31.800328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fbc1f-03a5-4b0d-974c-8e503202bb18 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:31.800835 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fbc1f-03a5-4b0d-974c-8e503202bb18 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:31.801109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fbc1f-03a5-4b0d-974c-8e503202bb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:31.823729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d97fbc1f-03a5-4b0d-974c-8e503202bb18 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:31.825387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d97fbc1f-03a5-4b0d-974c-8e503202bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:31.835323 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1366/2762] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:42:31.839603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133aace-98e9-4b7c-b993-2bccda7a745c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:31.850533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133aace-98e9-4b7c-b993-2bccda7a745c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:31.856592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f5ce8-a455-4baf-a3a0-3c86990f5a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:31.857234 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5ce8-a455-4baf-a3a0-3c86990f5a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:31.857531 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5ce8-a455-4baf-a3a0-3c86990f5a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:31.857778 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5ce8-a455-4baf-a3a0-3c86990f5a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:31.858543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f5ce8-a455-4baf-a3a0-3c86990f5a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:42:31.858909 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f5ce8-a455-4baf-a3a0-3c86990f5a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:31.861113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f5ce8-a455-4baf-a3a0-3c86990f5a4c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:31.876605 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1397/2763] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 04:42:31.881150 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fbc1f-03a5-4b0d-974c-8e503202bb18 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:31.893944 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fbc1f-03a5-4b0d-974c-8e503202bb18 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:31.899349 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df53ebb-dbbc-4e30-b1da-3abdb3d096a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:31.900175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53ebb-dbbc-4e30-b1da-3abdb3d096a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:31.900453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53ebb-dbbc-4e30-b1da-3abdb3d096a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:31.900730 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53ebb-dbbc-4e30-b1da-3abdb3d096a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:31.901462 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df53ebb-dbbc-4e30-b1da-3abdb3d096a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:31.903363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df53ebb-dbbc-4e30-b1da-3abdb3d096a8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:31.942105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1367/2764] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:42:31 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:42:31.946528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f5ce8-a455-4baf-a3a0-3c86990f5a4c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:31.957423 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f5ce8-a455-4baf-a3a0-3c86990f5a4c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.021749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2dcc3-4726-4672-85f9-ee0806626eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.022365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2dcc3-4726-4672-85f9-ee0806626eaf admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.022663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2dcc3-4726-4672-85f9-ee0806626eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.022930 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2dcc3-4726-4672-85f9-ee0806626eaf admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.023643 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2dcc3-4726-4672-85f9-ee0806626eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.025493 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2dcc3-4726-4672-85f9-ee0806626eaf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:32.049952 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1398/2765] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:42:31 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:42:32.054159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df53ebb-dbbc-4e30-b1da-3abdb3d096a8 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:32.065490 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df53ebb-dbbc-4e30-b1da-3abdb3d096a8 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.070915 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce328b6-2449-4fdd-9408-d523dc745753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.071558 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce328b6-2449-4fdd-9408-d523dc745753 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.071851 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce328b6-2449-4fdd-9408-d523dc745753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.072117 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce328b6-2449-4fdd-9408-d523dc745753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.072759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce328b6-2449-4fdd-9408-d523dc745753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.074393 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce328b6-2449-4fdd-9408-d523dc745753 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:32.086006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1368/2766] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:32.091808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2dcc3-4726-4672-85f9-ee0806626eaf admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:32.103567 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2dcc3-4726-4672-85f9-ee0806626eaf admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.108698 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2f2c6-2579-4e62-90f9-387ea5ef6ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.109352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f2c6-2579-4e62-90f9-387ea5ef6ede admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.109708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f2c6-2579-4e62-90f9-387ea5ef6ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.110007 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f2c6-2579-4e62-90f9-387ea5ef6ede admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.111009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2f2c6-2579-4e62-90f9-387ea5ef6ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.112654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2f2c6-2579-4e62-90f9-387ea5ef6ede admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:32.127178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1399/2767] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:32.128314 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce328b6-2449-4fdd-9408-d523dc745753 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:32.139109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce328b6-2449-4fdd-9408-d523dc745753 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.144474 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fadf9d-9cc3-4f6f-a9e7-715489b4d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.145350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fadf9d-9cc3-4f6f-a9e7-715489b4d4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.145907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fadf9d-9cc3-4f6f-a9e7-715489b4d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.146159 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fadf9d-9cc3-4f6f-a9e7-715489b4d4f8 admin admin] PATH_INFO: `/v3/projects/995e7f88f7cd4ecbb6eb36f4ccc41745/users/340c808c1f304a6eaa5b252480c0b87b/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.165004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fadf9d-9cc3-4f6f-a9e7-715489b4d4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=995e7f88f7cd4ecbb6eb36f4ccc41745, user_id=340c808c1f304a6eaa5b252480c0b87b, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.167838 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fadf9d-9cc3-4f6f-a9e7-715489b4d4f8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:32.181947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1369/2768] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:42:32 2022] PUT /identity/v3/projects/995e7f88f7cd4ecbb6eb36f4ccc41745/users/340c808c1f304a6eaa5b252480c0b87b/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:32.248728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85092d94-d9de-401c-9875-c27d56acadba None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.249028 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85092d94-d9de-401c-9875-c27d56acadba None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.249254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85092d94-d9de-401c-9875-c27d56acadba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.278534 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-85092d94-d9de-401c-9875-c27d56acadba None None] MFA Rules not processed for user `340c808c1f304a6eaa5b252480c0b87b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:32.279784 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-85092d94-d9de-401c-9875-c27d56acadba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:32.296972 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:32.345640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1400/2769] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:32.350251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fadf9d-9cc3-4f6f-a9e7-715489b4d4f8 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:32.360912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:32.414226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fadf9d-9cc3-4f6f-a9e7-715489b4d4f8 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.420191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4a51c-53c3-4c51-9ad7-8e0c1382c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.420791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4a51c-53c3-4c51-9ad7-8e0c1382c0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.421061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4a51c-53c3-4c51-9ad7-8e0c1382c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.421390 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4a51c-53c3-4c51-9ad7-8e0c1382c0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.422126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4a51c-53c3-4c51-9ad7-8e0c1382c0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.424083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4a51c-53c3-4c51-9ad7-8e0c1382c0e2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:32.454709 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1370/2770] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:42:32 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:42:32.458931 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85092d94-d9de-401c-9875-c27d56acadba None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:32.470125 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85092d94-d9de-401c-9875-c27d56acadba None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.530247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35541335-913c-4b02-8f13-d4fc28e7e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.530862 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35541335-913c-4b02-8f13-d4fc28e7e1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.531138 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35541335-913c-4b02-8f13-d4fc28e7e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.531469 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35541335-913c-4b02-8f13-d4fc28e7e1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.532112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35541335-913c-4b02-8f13-d4fc28e7e1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.534016 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35541335-913c-4b02-8f13-d4fc28e7e1e4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:32.558540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1401/2771] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:42:32 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:42:32.562801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4a51c-53c3-4c51-9ad7-8e0c1382c0e2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:32.573258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4a51c-53c3-4c51-9ad7-8e0c1382c0e2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.578269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6c21c-1e3e-4878-9a8d-b7644120b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.578869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6c21c-1e3e-4878-9a8d-b7644120b1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.579147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6c21c-1e3e-4878-9a8d-b7644120b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.579438 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6c21c-1e3e-4878-9a8d-b7644120b1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.580109 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6c21c-1e3e-4878-9a8d-b7644120b1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.581707 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6c21c-1e3e-4878-9a8d-b7644120b1b7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:32.592283 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1371/2772] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:32.596256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35541335-913c-4b02-8f13-d4fc28e7e1e4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:32.607159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35541335-913c-4b02-8f13-d4fc28e7e1e4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.613371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85610a7b-ea8e-4722-a48e-5a78b5d58a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.613998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610a7b-ea8e-4722-a48e-5a78b5d58a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.614316 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610a7b-ea8e-4722-a48e-5a78b5d58a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.614579 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610a7b-ea8e-4722-a48e-5a78b5d58a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.615223 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85610a7b-ea8e-4722-a48e-5a78b5d58a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.616835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85610a7b-ea8e-4722-a48e-5a78b5d58a65 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:32.627606 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1402/2773] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:32.631685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6c21c-1e3e-4878-9a8d-b7644120b1b7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:32.642424 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6c21c-1e3e-4878-9a8d-b7644120b1b7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.648434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c278e-d680-4f35-a5f4-92f5b962631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.649090 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c278e-d680-4f35-a5f4-92f5b962631e admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.649355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c278e-d680-4f35-a5f4-92f5b962631e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.649622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c278e-d680-4f35-a5f4-92f5b962631e admin admin] PATH_INFO: `/v3/projects/476d423034ee48daa2787dad9e9d36e2/users/c078788fe03d4c45a046ab9dc40746f8/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.665387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c278e-d680-4f35-a5f4-92f5b962631e admin admin] RBAC: Authorizing `identity:create_grant(project_id=476d423034ee48daa2787dad9e9d36e2, user_id=c078788fe03d4c45a046ab9dc40746f8, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.667992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c278e-d680-4f35-a5f4-92f5b962631e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:32.683050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1372/2774] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:42:32 2022] PUT /identity/v3/projects/476d423034ee48daa2787dad9e9d36e2/users/c078788fe03d4c45a046ab9dc40746f8/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:32.693824 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7692-8fce-401c-9a12-f3027d60d82a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.694102 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7692-8fce-401c-9a12-f3027d60d82a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.694374 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7692-8fce-401c-9a12-f3027d60d82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.723224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-073f7692-8fce-401c-9a12-f3027d60d82a None None] MFA Rules not processed for user `c078788fe03d4c45a046ab9dc40746f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:32.724478 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-073f7692-8fce-401c-9a12-f3027d60d82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:32.802228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1403/2775] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:32.806994 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c278e-d680-4f35-a5f4-92f5b962631e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:32.873355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c278e-d680-4f35-a5f4-92f5b962631e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.878948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d6f2a-39b5-483b-b320-04b429408e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.879562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d6f2a-39b5-483b-b320-04b429408e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.879864 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d6f2a-39b5-483b-b320-04b429408e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.880136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d6f2a-39b5-483b-b320-04b429408e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.880758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d6f2a-39b5-483b-b320-04b429408e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.882669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d6f2a-39b5-483b-b320-04b429408e03 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:32.912744 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1373/2776] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:42:32 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:42:32.917195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7692-8fce-401c-9a12-f3027d60d82a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:32.936355 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7692-8fce-401c-9a12-f3027d60d82a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:32.962568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:32.995419 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593b0f4-4119-42c1-92ac-a7472ff514ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:32.996022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593b0f4-4119-42c1-92ac-a7472ff514ca admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:32.996293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593b0f4-4119-42c1-92ac-a7472ff514ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:32.996558 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593b0f4-4119-42c1-92ac-a7472ff514ca admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:32.997172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593b0f4-4119-42c1-92ac-a7472ff514ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:32.999064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593b0f4-4119-42c1-92ac-a7472ff514ca admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:33.023297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1404/2777] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:42:32 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:42:33.027549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d6f2a-39b5-483b-b320-04b429408e03 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:33.037975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d6f2a-39b5-483b-b320-04b429408e03 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:33.042642 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325f45e-7a7c-4252-a475-fc296559fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:33.043276 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325f45e-7a7c-4252-a475-fc296559fbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:33.043562 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325f45e-7a7c-4252-a475-fc296559fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:33.043829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325f45e-7a7c-4252-a475-fc296559fbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:33.044464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325f45e-7a7c-4252-a475-fc296559fbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:33.046060 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325f45e-7a7c-4252-a475-fc296559fbb3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:33.056910 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1374/2778] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:33.061844 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593b0f4-4119-42c1-92ac-a7472ff514ca admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:33.072711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593b0f4-4119-42c1-92ac-a7472ff514ca admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:33.078350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e4b32-2646-4970-afb9-fa06d1163b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:33.079059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e4b32-2646-4970-afb9-fa06d1163b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:33.079328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e4b32-2646-4970-afb9-fa06d1163b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:33.079830 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e4b32-2646-4970-afb9-fa06d1163b48 admin admin] PATH_INFO: `/v3/projects/b003fb4eb7ca4baa9bc6a1a69c5f8c84/users/3963af90f5eb4c6c8e4999b7350ed5f3/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:33.098006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e4b32-2646-4970-afb9-fa06d1163b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b003fb4eb7ca4baa9bc6a1a69c5f8c84, user_id=3963af90f5eb4c6c8e4999b7350ed5f3, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:33.100674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e4b32-2646-4970-afb9-fa06d1163b48 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:33.116388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1405/2779] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:42:33 2022] PUT /identity/v3/projects/b003fb4eb7ca4baa9bc6a1a69c5f8c84/users/3963af90f5eb4c6c8e4999b7350ed5f3/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:33.120580 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325f45e-7a7c-4252-a475-fc296559fbb3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:33.130962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325f45e-7a7c-4252-a475-fc296559fbb3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:33.162002 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:33.197760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e701f6-8516-42cf-957a-be6e07fc67e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:33.198377 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e701f6-8516-42cf-957a-be6e07fc67e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:33.198651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e701f6-8516-42cf-957a-be6e07fc67e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:33.198919 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e701f6-8516-42cf-957a-be6e07fc67e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:33.199620 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e701f6-8516-42cf-957a-be6e07fc67e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:33.201287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e701f6-8516-42cf-957a-be6e07fc67e8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:33.207177 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a7266-44cf-423d-8a8d-5d27b4da191a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:33.207542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a7266-44cf-423d-8a8d-5d27b4da191a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:33.207901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a7266-44cf-423d-8a8d-5d27b4da191a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:33.212801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1375/2780] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:42:33.217012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e701f6-8516-42cf-957a-be6e07fc67e8 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:33.227287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e701f6-8516-42cf-957a-be6e07fc67e8 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:33.228816 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-458a7266-44cf-423d-8a8d-5d27b4da191a None None] MFA Rules not processed for user `5730e60637584aa5a2665a9107922978`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:33.230022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-458a7266-44cf-423d-8a8d-5d27b4da191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:33.233112 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb919d8-ba5f-4a3c-b118-19af4e8ac6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:33.233752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb919d8-ba5f-4a3c-b118-19af4e8ac6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:33.234073 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb919d8-ba5f-4a3c-b118-19af4e8ac6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:33.234351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb919d8-ba5f-4a3c-b118-19af4e8ac6b2 admin admin] PATH_INFO: `/v3/projects/b003fb4eb7ca4baa9bc6a1a69c5f8c84/users/3963af90f5eb4c6c8e4999b7350ed5f3/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:33.236796 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb919d8-ba5f-4a3c-b118-19af4e8ac6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b003fb4eb7ca4baa9bc6a1a69c5f8c84, user_id=3963af90f5eb4c6c8e4999b7350ed5f3, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:33.239512 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb919d8-ba5f-4a3c-b118-19af4e8ac6b2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:33.249964 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1376/2781] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:42:33 2022] PUT /identity/v3/projects/b003fb4eb7ca4baa9bc6a1a69c5f8c84/users/3963af90f5eb4c6c8e4999b7350ed5f3/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:33.261798 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571ef16-3e48-4e1d-973d-3413bee88d71 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:33.262091 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571ef16-3e48-4e1d-973d-3413bee88d71 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:33.262360 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571ef16-3e48-4e1d-973d-3413bee88d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:33.290391 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3571ef16-3e48-4e1d-973d-3413bee88d71 None None] MFA Rules not processed for user `3963af90f5eb4c6c8e4999b7350ed5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:33.291019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1406/2782] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:42:33.291743 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3571ef16-3e48-4e1d-973d-3413bee88d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:33.334600 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a7266-44cf-423d-8a8d-5d27b4da191a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:33.336112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-458a7266-44cf-423d-8a8d-5d27b4da191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:33.367710 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1377/2783] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:42:33.379126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571ef16-3e48-4e1d-973d-3413bee88d71 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:33.380726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3571ef16-3e48-4e1d-973d-3413bee88d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:33.394100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a7266-44cf-423d-8a8d-5d27b4da191a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:33.437294 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571ef16-3e48-4e1d-973d-3413bee88d71 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:33.440919 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013f3d2-6770-4fac-be07-61b207ffb2dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:33.441528 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013f3d2-6770-4fac-be07-61b207ffb2dc service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:33.441800 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013f3d2-6770-4fac-be07-61b207ffb2dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:33.442174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013f3d2-6770-4fac-be07-61b207ffb2dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:33.447059 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6a274-3315-4e8d-9d85-e4b1ccf7bff2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '457880195ed849d2b594ddea6acdf7df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:33.447723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6a274-3315-4e8d-9d85-e4b1ccf7bff2 service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:33.447994 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6a274-3315-4e8d-9d85-e4b1ccf7bff2 service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:33.448258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6a274-3315-4e8d-9d85-e4b1ccf7bff2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:33.450017 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-17a6a274-3315-4e8d-9d85-e4b1ccf7bff2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:33.456221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:33.497335 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:33.500202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013f3d2-6770-4fac-be07-61b207ffb2dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:33.502205 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013f3d2-6770-4fac-be07-61b207ffb2dc service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:33.513491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1378/2784] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:33.521483 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6a274-3315-4e8d-9d85-e4b1ccf7bff2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:33.522915 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6a274-3315-4e8d-9d85-e4b1ccf7bff2 service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:33.534056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1407/2785] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 04:42:34.089430 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013f3d2-6770-4fac-be07-61b207ffb2dc service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:34.090890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e013f3d2-6770-4fac-be07-61b207ffb2dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:34.153797 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013f3d2-6770-4fac-be07-61b207ffb2dc service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:34.157681 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b830d1-731a-41b7-8aea-96fcadbed790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:34.158292 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b830d1-731a-41b7-8aea-96fcadbed790 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:34.158568 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b830d1-731a-41b7-8aea-96fcadbed790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:34.158852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b830d1-731a-41b7-8aea-96fcadbed790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:34.160836 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-51b830d1-731a-41b7-8aea-96fcadbed790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:34.175384 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b830d1-731a-41b7-8aea-96fcadbed790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:34.176827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b830d1-731a-41b7-8aea-96fcadbed790 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:34.188241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1379/2786] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:35.038903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6a274-3315-4e8d-9d85-e4b1ccf7bff2 service glance] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:35.040635 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-17a6a274-3315-4e8d-9d85-e4b1ccf7bff2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:35.053488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6a274-3315-4e8d-9d85-e4b1ccf7bff2 service glance] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:35.059983 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49468f53-94e9-40a6-b56b-8904b8298e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:35.060800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49468f53-94e9-40a6-b56b-8904b8298e21 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:35.061077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49468f53-94e9-40a6-b56b-8904b8298e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:35.061443 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49468f53-94e9-40a6-b56b-8904b8298e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:35.122294 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49468f53-94e9-40a6-b56b-8904b8298e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:35.123805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49468f53-94e9-40a6-b56b-8904b8298e21 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:35.133434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1408/2787] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:35.580581 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8f6f-7cd1-4570-baab-96fdccf47544 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:35.581708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8f6f-7cd1-4570-baab-96fdccf47544 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:35.582318 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8f6f-7cd1-4570-baab-96fdccf47544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:35.614762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-215f8f6f-7cd1-4570-baab-96fdccf47544 None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:35.616762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-215f8f6f-7cd1-4570-baab-96fdccf47544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:35.680682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1380/2788] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:42:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:35.693812 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49468f53-94e9-40a6-b56b-8904b8298e21 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:35.695350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-49468f53-94e9-40a6-b56b-8904b8298e21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:35.746033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8f6f-7cd1-4570-baab-96fdccf47544 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:35.756520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8f6f-7cd1-4570-baab-96fdccf47544 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:35.760409 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4c265-852d-4943-9e2d-7db9df9ae020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:35.761222 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4c265-852d-4943-9e2d-7db9df9ae020 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:35.761491 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4c265-852d-4943-9e2d-7db9df9ae020 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:35.761758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4c265-852d-4943-9e2d-7db9df9ae020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:35.771829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4c265-852d-4943-9e2d-7db9df9ae020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:35.773494 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4c265-852d-4943-9e2d-7db9df9ae020 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:35.774004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49468f53-94e9-40a6-b56b-8904b8298e21 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:35.781569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4e1d9-438e-4769-bc19-8b4d0ffb9faa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:35.782471 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4e1d9-438e-4769-bc19-8b4d0ffb9faa service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:35.782954 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4e1d9-438e-4769-bc19-8b4d0ffb9faa service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:35.783315 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4e1d9-438e-4769-bc19-8b4d0ffb9faa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:35.783661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1381/2789] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:35.793008 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4e1d9-438e-4769-bc19-8b4d0ffb9faa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:35.794687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4e1d9-438e-4769-bc19-8b4d0ffb9faa service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:35.803904 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1409/2790] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:42:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:42:39.779501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4c265-852d-4943-9e2d-7db9df9ae020 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:39.850859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4c265-852d-4943-9e2d-7db9df9ae020 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:39.859058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:39.859058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:39.859058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:39.859058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] PATH_INFO: `/v3/users/340c808c1f304a6eaa5b252480c0b87b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:39.859673 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=340c808c1f304a6eaa5b252480c0b87b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:39.860649 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:39.900627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:39.915507 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340c808c1f304a6eaa5b252480c0b87b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:39.916213 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340c808c1f304a6eaa5b252480c0b87b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:39.925425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340c808c1f304a6eaa5b252480c0b87b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:39.945500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340c808c1f304a6eaa5b252480c0b87b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:39.953896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340c808c1f304a6eaa5b252480c0b87b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:39.965726 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1382/2791] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:42:39 2022] DELETE /identity/v3/users/340c808c1f304a6eaa5b252480c0b87b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:39.967859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca59f2-3457-4a6c-bac5-8691764e799a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:39.968772 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca59f2-3457-4a6c-bac5-8691764e799a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:39.969255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca59f2-3457-4a6c-bac5-8691764e799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:39.993611 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f8ca59f2-3457-4a6c-bac5-8691764e799a None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:42:39.994820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f8ca59f2-3457-4a6c-bac5-8691764e799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:40.023255 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:40.080003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1410/2792] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:42:40.089352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:40.090776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:40.161968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499e0b-1931-4610-98a1-d6b93c59c03c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:40.165723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758be6e3-168e-4e8f-a53e-d4e57e70d5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:40.166364 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758be6e3-168e-4e8f-a53e-d4e57e70d5ca service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:40.166638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758be6e3-168e-4e8f-a53e-d4e57e70d5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:40.166909 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758be6e3-168e-4e8f-a53e-d4e57e70d5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:40.178013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758be6e3-168e-4e8f-a53e-d4e57e70d5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:40.179737 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758be6e3-168e-4e8f-a53e-d4e57e70d5ca service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:40.190758 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1383/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:42:40.486999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca59f2-3457-4a6c-bac5-8691764e799a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:40.494655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f8ca59f2-3457-4a6c-bac5-8691764e799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:40.516570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca59f2-3457-4a6c-bac5-8691764e799a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:40.521256 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:40.521890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:40.522162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:40.522428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] PATH_INFO: `/v3/projects/995e7f88f7cd4ecbb6eb36f4ccc41745` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:40.523569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=995e7f88f7cd4ecbb6eb36f4ccc41745)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:40.525472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:40.579573 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995e7f88f7cd4ecbb6eb36f4ccc41745', 'request_id': 'req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:40.588464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995e7f88f7cd4ecbb6eb36f4ccc41745', 'request_id': 'req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:40.594731 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995e7f88f7cd4ecbb6eb36f4ccc41745', 'request_id': 'req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:40.606833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] The token cache is being invalidate because project 995e7f88f7cd4ecbb6eb36f4ccc41745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:42:40.607123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:40.608440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:40.609653 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1411/2794] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:42:40 2022] DELETE /identity/v3/projects/995e7f88f7cd4ecbb6eb36f4ccc41745 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:40.614003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758be6e3-168e-4e8f-a53e-d4e57e70d5ca service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:40.624938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758be6e3-168e-4e8f-a53e-d4e57e70d5ca service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:40.686198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:40.686906 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:40.687365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:40.687716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] PATH_INFO: `/v3/users/c078788fe03d4c45a046ab9dc40746f8` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:40.692189 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c078788fe03d4c45a046ab9dc40746f8)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:40.694174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:40.754034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c078788fe03d4c45a046ab9dc40746f8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:40.754706 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c078788fe03d4c45a046ab9dc40746f8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:40.762929 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c078788fe03d4c45a046ab9dc40746f8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:40.764315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:40.783184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c078788fe03d4c45a046ab9dc40746f8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:40.791464 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c078788fe03d4c45a046ab9dc40746f8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:40.798981 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1384/2795] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:42:40 2022] DELETE /identity/v3/users/c078788fe03d4c45a046ab9dc40746f8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:41.113301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:41.114763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:41.143846 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd9037-b6b9-461f-a4a6-1c80e9ee98ac admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:41.222613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:41.223553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:41.223964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:41.224299 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] PATH_INFO: `/v3/projects/476d423034ee48daa2787dad9e9d36e2` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:41.225818 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476d423034ee48daa2787dad9e9d36e2)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:41.228115 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:41.293867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:41.298631 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476d423034ee48daa2787dad9e9d36e2', 'request_id': 'req-43610f14-214d-4f06-a39c-3b40523d38e0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.311251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476d423034ee48daa2787dad9e9d36e2', 'request_id': 'req-43610f14-214d-4f06-a39c-3b40523d38e0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.334521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476d423034ee48daa2787dad9e9d36e2', 'request_id': 'req-43610f14-214d-4f06-a39c-3b40523d38e0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.346694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] The token cache is being invalidate because project 476d423034ee48daa2787dad9e9d36e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:42:41.347117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.347901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.349554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1412/2796] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:42:41 2022] DELETE /identity/v3/projects/476d423034ee48daa2787dad9e9d36e2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:41.353569 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:41.355079 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:41.368872 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494d8a5-bef3-45d1-b5ca-002c52cb989a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:41.428018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:41.428801 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:41.429140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:41.429412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] PATH_INFO: `/v3/users/3963af90f5eb4c6c8e4999b7350ed5f3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:41.430682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3963af90f5eb4c6c8e4999b7350ed5f3)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:41.432830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:41.482885 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3963af90f5eb4c6c8e4999b7350ed5f3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.483923 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3963af90f5eb4c6c8e4999b7350ed5f3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.492750 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3963af90f5eb4c6c8e4999b7350ed5f3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.510481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3963af90f5eb4c6c8e4999b7350ed5f3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.518450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3963af90f5eb4c6c8e4999b7350ed5f3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.525232 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1385/2797] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:42:41 2022] DELETE /identity/v3/users/3963af90f5eb4c6c8e4999b7350ed5f3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:41.824968 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:42:41.826820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:42:41.862363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43610f14-214d-4f06-a39c-3b40523d38e0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:42:41.924802 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:42:41.925397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:42:41.925848 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:42:41.926119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] PATH_INFO: `/v3/projects/b003fb4eb7ca4baa9bc6a1a69c5f8c84` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:42:41.927441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b003fb4eb7ca4baa9bc6a1a69c5f8c84)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:42:41.929362 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:42:41.981989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b003fb4eb7ca4baa9bc6a1a69c5f8c84', 'request_id': 'req-ee728b7f-84c8-4c59-86b3-8d33f5e42299'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.989822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b003fb4eb7ca4baa9bc6a1a69c5f8c84', 'request_id': 'req-ee728b7f-84c8-4c59-86b3-8d33f5e42299'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:41.996749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b003fb4eb7ca4baa9bc6a1a69c5f8c84', 'request_id': 'req-ee728b7f-84c8-4c59-86b3-8d33f5e42299'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:42.009709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] The token cache is being invalidate because project b003fb4eb7ca4baa9bc6a1a69c5f8c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:42:42.010130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:42.010897 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee728b7f-84c8-4c59-86b3-8d33f5e42299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:42:42.012916 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1413/2798] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:42:41 2022] DELETE /identity/v3/projects/b003fb4eb7ca4baa9bc6a1a69c5f8c84 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:42:51.521456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:52.005763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:43:01.010865 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:43:01.012535 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:01.073272 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2e12e-6634-4850-b6ca-50f3fb963945 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:43:01.124881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c60b-0a37-40ca-a1c2-77f556271ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:43:01.125501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c60b-0a37-40ca-a1c2-77f556271ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:43:01.125784 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c60b-0a37-40ca-a1c2-77f556271ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:43:01.126055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c60b-0a37-40ca-a1c2-77f556271ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:43:01.127824 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2e02c60b-0a37-40ca-a1c2-77f556271ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:01.201419 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c60b-0a37-40ca-a1c2-77f556271ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:43:01.202925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c60b-0a37-40ca-a1c2-77f556271ea1 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:43:01.214268 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1386/2799] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:43:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:43:02.280757 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33ed7-a46d-4ed8-a20c-9897afde0196 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:43:02.281330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33ed7-a46d-4ed8-a20c-9897afde0196 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:43:02.281330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33ed7-a46d-4ed8-a20c-9897afde0196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:43:02.302195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-57f33ed7-a46d-4ed8-a20c-9897afde0196 None None] MFA Rules not processed for user `d472fb0bb1c84ff18f03bf2bd510cc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:43:02.303666 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57f33ed7-a46d-4ed8-a20c-9897afde0196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:02.367151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1414/2800] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:43:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:43:02.845904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c60b-0a37-40ca-a1c2-77f556271ea1 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:43:02.847599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2e02c60b-0a37-40ca-a1c2-77f556271ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:02.860582 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c60b-0a37-40ca-a1c2-77f556271ea1 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:43:02.865399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e6daa-0796-47b1-90fd-2fb8c830e2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:43:02.866012 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e6daa-0796-47b1-90fd-2fb8c830e2bb service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:43:02.866286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e6daa-0796-47b1-90fd-2fb8c830e2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:43:02.866541 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e6daa-0796-47b1-90fd-2fb8c830e2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:43:02.868621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-505e6daa-0796-47b1-90fd-2fb8c830e2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:02.878802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e6daa-0796-47b1-90fd-2fb8c830e2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:43:02.880365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e6daa-0796-47b1-90fd-2fb8c830e2bb service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:43:02.888715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1387/2801] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:43:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:43:03.189414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33ed7-a46d-4ed8-a20c-9897afde0196 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:43:03.190876 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57f33ed7-a46d-4ed8-a20c-9897afde0196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:03.205170 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33ed7-a46d-4ed8-a20c-9897afde0196 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:43:03.209039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf6a88-5395-4748-b60b-f2208bb574dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:43:03.209661 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6a88-5395-4748-b60b-f2208bb574dd service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:43:03.209993 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6a88-5395-4748-b60b-f2208bb574dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:43:03.210301 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6a88-5395-4748-b60b-f2208bb574dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:43:03.212408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eaaf6a88-5395-4748-b60b-f2208bb574dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:03.223633 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf6a88-5395-4748-b60b-f2208bb574dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:43:03.225438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf6a88-5395-4748-b60b-f2208bb574dd service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:43:03.240726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1415/2802] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:43:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:43:03.350500 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e6daa-0796-47b1-90fd-2fb8c830e2bb service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:43:03.352853 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-505e6daa-0796-47b1-90fd-2fb8c830e2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:03.419588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:43:03.451203 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e6daa-0796-47b1-90fd-2fb8c830e2bb service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:43:03.456599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195e34-5a0f-4e9f-8316-b0a1458fa75a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:43:03.457502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195e34-5a0f-4e9f-8316-b0a1458fa75a service placement] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:43:03.457776 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195e34-5a0f-4e9f-8316-b0a1458fa75a service placement] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:43:03.458266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195e34-5a0f-4e9f-8316-b0a1458fa75a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:43:03.461003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d0195e34-5a0f-4e9f-8316-b0a1458fa75a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:03.489499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0195e34-5a0f-4e9f-8316-b0a1458fa75a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:43:03.492256 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0195e34-5a0f-4e9f-8316-b0a1458fa75a service placement] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:43:03.509829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1388/2803] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:43:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:43:05.145245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf6a88-5395-4748-b60b-f2208bb574dd service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:43:05.147561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eaaf6a88-5395-4748-b60b-f2208bb574dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:05.234577 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf6a88-5395-4748-b60b-f2208bb574dd service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:43:05.241852 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e2cb7-62f8-4673-922a-55ceec1231a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:43:05.242490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e2cb7-62f8-4673-922a-55ceec1231a1 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:43:05.242822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e2cb7-62f8-4673-922a-55ceec1231a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:43:05.243092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e2cb7-62f8-4673-922a-55ceec1231a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:43:05.244938 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c24e2cb7-62f8-4673-922a-55ceec1231a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:43:05.257620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e2cb7-62f8-4673-922a-55ceec1231a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:43:05.259228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e2cb7-62f8-4673-922a-55ceec1231a1 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:43:05.274076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1416/2804] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:43:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:43:13.499385 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=8 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:43:15.265668 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=65 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:44:30.589417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195e34-5a0f-4e9f-8316-b0a1458fa75a service placement] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:44:30.592715 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d0195e34-5a0f-4e9f-8316-b0a1458fa75a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:44:30.610190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195e34-5a0f-4e9f-8316-b0a1458fa75a service placement] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:44:30.616281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a5be-5d0d-4518-aa4f-373ed19831b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:44:30.616881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a5be-5d0d-4518-aa4f-373ed19831b7 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:44:30.617153 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a5be-5d0d-4518-aa4f-373ed19831b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:44:30.617448 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a5be-5d0d-4518-aa4f-373ed19831b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:44:30.619291 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f7a1a5be-5d0d-4518-aa4f-373ed19831b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:44:30.629867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1a5be-5d0d-4518-aa4f-373ed19831b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:44:30.631463 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1a5be-5d0d-4518-aa4f-373ed19831b7 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:44:30.640445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1389/2805] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:44:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:44:40.636688 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:44:49.248922 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e2cb7-62f8-4673-922a-55ceec1231a1 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:44:49.261113 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e2cb7-62f8-4673-922a-55ceec1231a1 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:44:49.267639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798a8f-aa96-4223-a923-fb85094a1f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:44:49.268254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798a8f-aa96-4223-a923-fb85094a1f8a service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:44:49.268528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798a8f-aa96-4223-a923-fb85094a1f8a service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:44:49.268795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798a8f-aa96-4223-a923-fb85094a1f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:44:49.270610 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-61798a8f-aa96-4223-a923-fb85094a1f8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:44:49.283614 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61798a8f-aa96-4223-a923-fb85094a1f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:44:49.285189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61798a8f-aa96-4223-a923-fb85094a1f8a service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:44:49.296397 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1417/2806] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:44:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:44:50.343846 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d85e-9cd6-474d-9c5b-e66ed0952377 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:44:50.344381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d85e-9cd6-474d-9c5b-e66ed0952377 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:44:50.344381 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d85e-9cd6-474d-9c5b-e66ed0952377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:44:50.397691 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cec6d85e-9cd6-474d-9c5b-e66ed0952377 None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:44:50.398897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cec6d85e-9cd6-474d-9c5b-e66ed0952377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:44:50.468952 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1390/2807] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:44:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:44:50.510034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798a8f-aa96-4223-a923-fb85094a1f8a service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:44:50.511646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-61798a8f-aa96-4223-a923-fb85094a1f8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:44:50.605123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798a8f-aa96-4223-a923-fb85094a1f8a service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:44:50.612158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564674f0-782f-48e9-9928-e4c9f5c3f32b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:44:50.612775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564674f0-782f-48e9-9928-e4c9f5c3f32b service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:44:50.613049 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564674f0-782f-48e9-9928-e4c9f5c3f32b service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:44:50.613309 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564674f0-782f-48e9-9928-e4c9f5c3f32b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:44:50.622753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564674f0-782f-48e9-9928-e4c9f5c3f32b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:44:50.624380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564674f0-782f-48e9-9928-e4c9f5c3f32b service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:44:50.633386 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1418/2808] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:44:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:45:00.465694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=40 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:45:00.629726 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=47 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:45:05.061186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d85e-9cd6-474d-9c5b-e66ed0952377 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:45:05.071184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d85e-9cd6-474d-9c5b-e66ed0952377 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:45:05.075050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab02dd-e977-4c8e-b8d6-a3276ebb35b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:45:05.075765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab02dd-e977-4c8e-b8d6-a3276ebb35b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:05.076047 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab02dd-e977-4c8e-b8d6-a3276ebb35b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:05.076362 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab02dd-e977-4c8e-b8d6-a3276ebb35b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:05.078089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f4ab02dd-e977-4c8e-b8d6-a3276ebb35b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:45:05.088127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab02dd-e977-4c8e-b8d6-a3276ebb35b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:45:05.089561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab02dd-e977-4c8e-b8d6-a3276ebb35b2 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:45:05.097958 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1391/2809] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:45:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:45:05.192995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564674f0-782f-48e9-9928-e4c9f5c3f32b service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:45:05.202885 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564674f0-782f-48e9-9928-e4c9f5c3f32b service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:45:05.206434 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c68f58-eb41-4414-9487-c37051a2ad2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:45:05.207039 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c68f58-eb41-4414-9487-c37051a2ad2e service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:05.207414 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c68f58-eb41-4414-9487-c37051a2ad2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:05.207875 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c68f58-eb41-4414-9487-c37051a2ad2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:05.209843 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-40c68f58-eb41-4414-9487-c37051a2ad2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:45:05.223774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c68f58-eb41-4414-9487-c37051a2ad2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:45:05.225331 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c68f58-eb41-4414-9487-c37051a2ad2e service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:45:05.237151 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1419/2810] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:45:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:45:07.061638 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b23afb-2525-4d43-aa1c-a0204e7fcc3d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:07.062164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b23afb-2525-4d43-aa1c-a0204e7fcc3d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:07.062164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b23afb-2525-4d43-aa1c-a0204e7fcc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:07.082475 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b3b23afb-2525-4d43-aa1c-a0204e7fcc3d None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:45:07.083693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b3b23afb-2525-4d43-aa1c-a0204e7fcc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:45:07.095918 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1392/2811] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Oct 6 04:45:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:45:07.108187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c68f58-eb41-4414-9487-c37051a2ad2e service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:45:07.121557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c68f58-eb41-4414-9487-c37051a2ad2e service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:45:07.127743 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc92cd0-5712-403e-bd04-26d936b07edf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:45:07.128350 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc92cd0-5712-403e-bd04-26d936b07edf service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:07.128609 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc92cd0-5712-403e-bd04-26d936b07edf service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:07.128878 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc92cd0-5712-403e-bd04-26d936b07edf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:07.138228 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc92cd0-5712-403e-bd04-26d936b07edf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:45:07.139845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc92cd0-5712-403e-bd04-26d936b07edf service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:45:07.147967 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1420/2812] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:45:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:45:17.077312 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=9 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:45:17.144608 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=12 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:45:27.392772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb8ff-b940-4a96-a640-b3589f35ee50 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:27.393685 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb8ff-b940-4a96-a640-b3589f35ee50 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:27.394197 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb8ff-b940-4a96-a640-b3589f35ee50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:27.415241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-952eb8ff-b940-4a96-a640-b3589f35ee50 None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:45:27.416493 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-952eb8ff-b940-4a96-a640-b3589f35ee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:45:27.424084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1393/2813] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 6 04:45:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:45:27.437917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc92cd0-5712-403e-bd04-26d936b07edf service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:45:27.449568 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc92cd0-5712-403e-bd04-26d936b07edf service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:45:27.455503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a74f9-80ac-4e9f-aaa8-3ab999e4fe38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:45:27.456323 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a74f9-80ac-4e9f-aaa8-3ab999e4fe38 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:27.456601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a74f9-80ac-4e9f-aaa8-3ab999e4fe38 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:27.456873 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a74f9-80ac-4e9f-aaa8-3ab999e4fe38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:27.465912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a74f9-80ac-4e9f-aaa8-3ab999e4fe38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:45:27.467560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a74f9-80ac-4e9f-aaa8-3ab999e4fe38 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:45:27.477858 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1421/2814] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:45:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:45:33.732669 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eb8ff-b940-4a96-a640-b3589f35ee50 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:45:33.745771 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eb8ff-b940-4a96-a640-b3589f35ee50 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:45:33.751113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fa8fe-b4fa-4093-b1c6-cf0a4afee88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0481d4c0be0b46189e339d1e00bee4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:45:33.751745 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fa8fe-b4fa-4093-b1c6-cf0a4afee88b service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:33.752018 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fa8fe-b4fa-4093-b1c6-cf0a4afee88b service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:33.752287 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fa8fe-b4fa-4093-b1c6-cf0a4afee88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:33.754137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-810fa8fe-b4fa-4093-b1c6-cf0a4afee88b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:45:33.766404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fa8fe-b4fa-4093-b1c6-cf0a4afee88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:45:33.768149 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fa8fe-b4fa-4093-b1c6-cf0a4afee88b service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:45:33.779096 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1394/2815] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:45:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:45:34.568560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c510647-17d4-43de-8e9d-74fe237e91d8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:34.569036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c510647-17d4-43de-8e9d-74fe237e91d8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:34.569036 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c510647-17d4-43de-8e9d-74fe237e91d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:34.589236 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8c510647-17d4-43de-8e9d-74fe237e91d8 None None] MFA Rules not processed for user `cdff0406366845169a481e3cd1188725`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:45:34.590440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8c510647-17d4-43de-8e9d-74fe237e91d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:45:34.598001 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1422/2816] 10.222.0.20 () {58 vars in 967 bytes} [Thu Oct 6 04:45:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:45:34.610912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fa8fe-b4fa-4093-b1c6-cf0a4afee88b service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:45:34.622985 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fa8fe-b4fa-4093-b1c6-cf0a4afee88b service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:45:34.628902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0812-4926-4f1c-8e3a-e63742bb252f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85602a9d62bc475fb5da609f97958d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:45:34.629496 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0812-4926-4f1c-8e3a-e63742bb252f service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:34.629773 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0812-4926-4f1c-8e3a-e63742bb252f service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:34.630041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0812-4926-4f1c-8e3a-e63742bb252f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:34.638362 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a0812-4926-4f1c-8e3a-e63742bb252f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:45:34.640013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a0812-4926-4f1c-8e3a-e63742bb252f service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:45:34.648029 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1395/2817] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Oct 6 04:45:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 04:45:41.161593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c510647-17d4-43de-8e9d-74fe237e91d8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:45:41.163164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8c510647-17d4-43de-8e9d-74fe237e91d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:45:41.246246 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c510647-17d4-43de-8e9d-74fe237e91d8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:45:41.250959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:45:41.251768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:41.252045 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:41.252320 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] PATH_INFO: `/v3/users/5730e60637584aa5a2665a9107922978` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:41.253852 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5730e60637584aa5a2665a9107922978)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:45:41.256153 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:45:41.306785 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5730e60637584aa5a2665a9107922978'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.315326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5730e60637584aa5a2665a9107922978'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.327589 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5730e60637584aa5a2665a9107922978'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.328286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5730e60637584aa5a2665a9107922978'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.335076 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5730e60637584aa5a2665a9107922978'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.341188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1423/2818] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:45:41 2022] DELETE /identity/v3/users/5730e60637584aa5a2665a9107922978 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:45:41.532399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0812-4926-4f1c-8e3a-e63742bb252f service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:45:41.545792 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0812-4926-4f1c-8e3a-e63742bb252f service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:45:41.611902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:45:41.613176 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:41.613473 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:41.613729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] PATH_INFO: `/v3/projects/6cf243cf66c346c4843d3b7beb3a1ddd` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:41.614896 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf243cf66c346c4843d3b7beb3a1ddd)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:45:41.616821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:45:41.664533 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf243cf66c346c4843d3b7beb3a1ddd', 'request_id': 'req-0f91b2d6-efd4-4390-8110-cfe780454a19'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.672076 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf243cf66c346c4843d3b7beb3a1ddd', 'request_id': 'req-0f91b2d6-efd4-4390-8110-cfe780454a19'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.678088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf243cf66c346c4843d3b7beb3a1ddd', 'request_id': 'req-0f91b2d6-efd4-4390-8110-cfe780454a19'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.691200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] The token cache is being invalidate because project 6cf243cf66c346c4843d3b7beb3a1ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:45:41.691200 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.691534 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.693365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1396/2819] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:45:41 2022] DELETE /identity/v3/projects/6cf243cf66c346c4843d3b7beb3a1ddd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:45:41.697214 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:45:41.698676 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:45:41.712335 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c80f84-7ef5-497c-9ae3-a12977b1615f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:45:41.775936 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:45:41.776721 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:41.777040 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:41.777369 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] PATH_INFO: `/v3/users/83bac4a40715415fb547d34d9bfae964` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:41.779086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bac4a40715415fb547d34d9bfae964)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:45:41.781754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:45:41.784185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:45:41.834396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bac4a40715415fb547d34d9bfae964'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.842874 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bac4a40715415fb547d34d9bfae964'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.856654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bac4a40715415fb547d34d9bfae964'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.857288 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bac4a40715415fb547d34d9bfae964'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.865022 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bac4a40715415fb547d34d9bfae964'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:41.871037 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1424/2820] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:45:41 2022] DELETE /identity/v3/users/83bac4a40715415fb547d34d9bfae964 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:45:42.058928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:45:42.060455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:45:42.074788 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91b2d6-efd4-4390-8110-cfe780454a19 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:45:42.134226 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:45:42.141084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:45:42.141956 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:45:42.142514 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:45:42.142968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] PATH_INFO: `/v3/projects/373207b07bb24927a6379334b344ad17` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:45:42.144310 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373207b07bb24927a6379334b344ad17)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:45:42.146859 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:45:42.195829 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373207b07bb24927a6379334b344ad17', 'request_id': 'req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:42.206356 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373207b07bb24927a6379334b344ad17', 'request_id': 'req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:42.212993 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373207b07bb24927a6379334b344ad17', 'request_id': 'req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:42.224985 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] The token cache is being invalidate because project 373207b07bb24927a6379334b344ad17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:45:42.225270 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:42.225930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:45:42.227526 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1397/2821] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:45:42 2022] DELETE /identity/v3/projects/373207b07bb24927a6379334b344ad17 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:45:51.867777 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:45:52.221313 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:27.691860 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:27.693546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:27.765137 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0edb2-928b-400f-92bb-379bbc8cff62 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:27.827095 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c86ca1-688b-4574-8e55-35ab8ec2a552 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:27.827788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c86ca1-688b-4574-8e55-35ab8ec2a552 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:27.828061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c86ca1-688b-4574-8e55-35ab8ec2a552 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:27.828295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c86ca1-688b-4574-8e55-35ab8ec2a552 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:27.830195 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-35c86ca1-688b-4574-8e55-35ab8ec2a552 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:27.841504 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c86ca1-688b-4574-8e55-35ab8ec2a552 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:27.843077 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c86ca1-688b-4574-8e55-35ab8ec2a552 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:27.853262 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1425/2822] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:46:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:46:32.663622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:32.665387 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:32.730119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58179a-eff7-4b5a-9b57-8c18c13c6d98 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:32.734542 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61d926-1a0a-434c-ae72-3be5b0babc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:32.735140 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61d926-1a0a-434c-ae72-3be5b0babc94 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:32.735441 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61d926-1a0a-434c-ae72-3be5b0babc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:32.735708 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61d926-1a0a-434c-ae72-3be5b0babc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:32.737851 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-be61d926-1a0a-434c-ae72-3be5b0babc94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:32.805537 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61d926-1a0a-434c-ae72-3be5b0babc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:32.806948 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61d926-1a0a-434c-ae72-3be5b0babc94 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:32.817400 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1398/2823] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:46:35.904254 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c86ca1-688b-4574-8e55-35ab8ec2a552 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:35.905803 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-35c86ca1-688b-4574-8e55-35ab8ec2a552 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:35.935901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c86ca1-688b-4574-8e55-35ab8ec2a552 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:35.956741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815eb87-ea71-4cf8-942a-68edaeb992e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:35.957425 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815eb87-ea71-4cf8-942a-68edaeb992e0 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:35.957699 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815eb87-ea71-4cf8-942a-68edaeb992e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:35.957999 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815eb87-ea71-4cf8-942a-68edaeb992e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:35.962576 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b815eb87-ea71-4cf8-942a-68edaeb992e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:35.981352 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61d926-1a0a-434c-ae72-3be5b0babc94 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:35.983036 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-be61d926-1a0a-434c-ae72-3be5b0babc94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:35.985295 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815eb87-ea71-4cf8-942a-68edaeb992e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:35.986898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815eb87-ea71-4cf8-942a-68edaeb992e0 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:35.998120 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1426/2824] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:46:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:46:36.001184 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61d926-1a0a-434c-ae72-3be5b0babc94 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:36.006083 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:36.006723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.006995 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.007264 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] PATH_INFO: `/v3/users/d472fb0bb1c84ff18f03bf2bd510cc6f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.008401 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d472fb0bb1c84ff18f03bf2bd510cc6f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:36.010482 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:36.072733 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd472fb0bb1c84ff18f03bf2bd510cc6f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:36.073785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd472fb0bb1c84ff18f03bf2bd510cc6f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:36.084971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd472fb0bb1c84ff18f03bf2bd510cc6f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:36.100839 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd472fb0bb1c84ff18f03bf2bd510cc6f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:36.109265 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-cd798d45-cb28-4c1f-b2fa-def97baf1947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd472fb0bb1c84ff18f03bf2bd510cc6f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:36.116683 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1399/2825] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:46:35 2022] DELETE /identity/v3/users/d472fb0bb1c84ff18f03bf2bd510cc6f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:36.300281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815eb87-ea71-4cf8-942a-68edaeb992e0 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:36.312353 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815eb87-ea71-4cf8-942a-68edaeb992e0 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:36.375196 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:36.375882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.376160 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.376428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] PATH_INFO: `/v3/projects/34977660f3f9474a8f5b075b369ece33` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.377547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34977660f3f9474a8f5b075b369ece33)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:36.379796 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:36.402939 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:36.433202 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34977660f3f9474a8f5b075b369ece33', 'request_id': 'req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:36.444879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34977660f3f9474a8f5b075b369ece33', 'request_id': 'req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:36.450533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34977660f3f9474a8f5b075b369ece33', 'request_id': 'req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:36.462269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] The token cache is being invalidate because project 34977660f3f9474a8f5b075b369ece33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:46:36.462557 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:36.463217 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7c4cfa9d-6c88-4d3b-8af6-95f5d7337500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:36.464733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1427/2826] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:46:36 2022] DELETE /identity/v3/projects/34977660f3f9474a8f5b075b369ece33 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:36.469897 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f14eb-2a20-4240-bc2d-998fa33f3d8b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.470175 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f14eb-2a20-4240-bc2d-998fa33f3d8b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.470439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f14eb-2a20-4240-bc2d-998fa33f3d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.491924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6e3f14eb-2a20-4240-bc2d-998fa33f3d8b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:36.493135 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6e3f14eb-2a20-4240-bc2d-998fa33f3d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:36.510942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:36.557016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1400/2827] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:36.565412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b1e69-c7d8-40fa-8a34-988cf68dd92b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.565710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b1e69-c7d8-40fa-8a34-988cf68dd92b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.566072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b1e69-c7d8-40fa-8a34-988cf68dd92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.589013 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cd1b1e69-c7d8-40fa-8a34-988cf68dd92b None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:36.590269 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cd1b1e69-c7d8-40fa-8a34-988cf68dd92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:36.600685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1428/2828] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:36.605273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f14eb-2a20-4240-bc2d-998fa33f3d8b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:36.616216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f14eb-2a20-4240-bc2d-998fa33f3d8b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:36.622011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a515b-c6cb-469d-800d-57d10e673e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:36.622618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a515b-c6cb-469d-800d-57d10e673e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.622890 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a515b-c6cb-469d-800d-57d10e673e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.623185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a515b-c6cb-469d-800d-57d10e673e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.623861 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a515b-c6cb-469d-800d-57d10e673e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:46:36.624163 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a515b-c6cb-469d-800d-57d10e673e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:36.625790 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a515b-c6cb-469d-800d-57d10e673e74 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:36.638157 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1401/2829] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:46:36.642604 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b1e69-c7d8-40fa-8a34-988cf68dd92b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:36.652499 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b1e69-c7d8-40fa-8a34-988cf68dd92b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:36.657805 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b70094-678b-47ab-96b6-90c7f4a12eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:36.658408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b70094-678b-47ab-96b6-90c7f4a12eeb admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.658687 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b70094-678b-47ab-96b6-90c7f4a12eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.658959 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b70094-678b-47ab-96b6-90c7f4a12eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.659700 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b70094-678b-47ab-96b6-90c7f4a12eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:36.661639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b70094-678b-47ab-96b6-90c7f4a12eeb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:36.693286 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1429/2830] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:46:36 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:36.697876 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a515b-c6cb-469d-800d-57d10e673e74 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:36.708486 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a515b-c6cb-469d-800d-57d10e673e74 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:36.770902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ecf3c-6cea-4934-a994-1f21651eddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:36.771596 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ecf3c-6cea-4934-a994-1f21651eddfe admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.771875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ecf3c-6cea-4934-a994-1f21651eddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.772165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ecf3c-6cea-4934-a994-1f21651eddfe admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.772789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ecf3c-6cea-4934-a994-1f21651eddfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:36.774699 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ecf3c-6cea-4934-a994-1f21651eddfe admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:36.797921 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1402/2831] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:46:36 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:36.802530 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b70094-678b-47ab-96b6-90c7f4a12eeb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:36.813056 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b70094-678b-47ab-96b6-90c7f4a12eeb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:36.818162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8308e8-bb8b-44fd-ad5d-0f07b410b90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:36.818767 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8308e8-bb8b-44fd-ad5d-0f07b410b90a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.819034 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8308e8-bb8b-44fd-ad5d-0f07b410b90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.819333 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8308e8-bb8b-44fd-ad5d-0f07b410b90a admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.819988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8308e8-bb8b-44fd-ad5d-0f07b410b90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:36.821570 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8308e8-bb8b-44fd-ad5d-0f07b410b90a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:36.832094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1430/2832] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:46:36.835857 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ecf3c-6cea-4934-a994-1f21651eddfe admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:36.846799 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ecf3c-6cea-4934-a994-1f21651eddfe admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:36.852095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7b956-4b3e-4ccf-b7fd-b41fee8548ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:36.852695 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b956-4b3e-4ccf-b7fd-b41fee8548ed admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.852970 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b956-4b3e-4ccf-b7fd-b41fee8548ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.853236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b956-4b3e-4ccf-b7fd-b41fee8548ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.853878 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7b956-4b3e-4ccf-b7fd-b41fee8548ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:36.855544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7b956-4b3e-4ccf-b7fd-b41fee8548ed admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:36.867218 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1403/2833] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:46:36.871408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8308e8-bb8b-44fd-ad5d-0f07b410b90a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:36.881456 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8308e8-bb8b-44fd-ad5d-0f07b410b90a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:36.886204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757751ea-da4a-4500-b7a8-084d6d9759ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:36.886859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757751ea-da4a-4500-b7a8-084d6d9759ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.887140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757751ea-da4a-4500-b7a8-084d6d9759ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.887427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757751ea-da4a-4500-b7a8-084d6d9759ba admin admin] PATH_INFO: `/v3/projects/5776aa4cf33e4a03bcafd86204c4de0f/users/dedef7a88422483aa2c26e152dab1d32/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.902388 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757751ea-da4a-4500-b7a8-084d6d9759ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5776aa4cf33e4a03bcafd86204c4de0f, user_id=dedef7a88422483aa2c26e152dab1d32, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:36.905094 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757751ea-da4a-4500-b7a8-084d6d9759ba admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:36.920598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1431/2834] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:46:36 2022] PUT /identity/v3/projects/5776aa4cf33e4a03bcafd86204c4de0f/users/dedef7a88422483aa2c26e152dab1d32/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:36.925736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a811-4f87-4841-a44e-1b0643a1596e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:36.926011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a811-4f87-4841-a44e-1b0643a1596e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:36.926277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a811-4f87-4841-a44e-1b0643a1596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:36.945094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9493a811-4f87-4841-a44e-1b0643a1596e None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:36.946204 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9493a811-4f87-4841-a44e-1b0643a1596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:37.005972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1404/2835] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:37.015880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757751ea-da4a-4500-b7a8-084d6d9759ba admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:37.017734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-757751ea-da4a-4500-b7a8-084d6d9759ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:37.080780 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757751ea-da4a-4500-b7a8-084d6d9759ba admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:37.085373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a84338-4991-4c7e-9eab-8972d8e358c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:37.085995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a84338-4991-4c7e-9eab-8972d8e358c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:37.086274 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a84338-4991-4c7e-9eab-8972d8e358c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:37.086543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a84338-4991-4c7e-9eab-8972d8e358c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:37.096224 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a84338-4991-4c7e-9eab-8972d8e358c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:37.097893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a84338-4991-4c7e-9eab-8972d8e358c4 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:37.107734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1432/2836] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:46:37.750627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501555e-0a9d-4eff-9fcc-8b98cfa9e9a0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:37.750962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501555e-0a9d-4eff-9fcc-8b98cfa9e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:37.751241 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501555e-0a9d-4eff-9fcc-8b98cfa9e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:37.783262 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d501555e-0a9d-4eff-9fcc-8b98cfa9e9a0 None None] MFA Rules not processed for user `dedef7a88422483aa2c26e152dab1d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:37.784593 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d501555e-0a9d-4eff-9fcc-8b98cfa9e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:37.802172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:37.854711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1405/2837] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:37 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:37.859753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a84338-4991-4c7e-9eab-8972d8e358c4 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:37.869170 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a84338-4991-4c7e-9eab-8972d8e358c4 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:37.874020 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66467f4f-7706-40b0-a4b5-7f4761f24944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:37.874613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66467f4f-7706-40b0-a4b5-7f4761f24944 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:37.874884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66467f4f-7706-40b0-a4b5-7f4761f24944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:37.875145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66467f4f-7706-40b0-a4b5-7f4761f24944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:37.875819 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66467f4f-7706-40b0-a4b5-7f4761f24944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:37.877689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66467f4f-7706-40b0-a4b5-7f4761f24944 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:37.910655 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1433/2838] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:46:37 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:37.912055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501555e-0a9d-4eff-9fcc-8b98cfa9e9a0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:37.923061 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501555e-0a9d-4eff-9fcc-8b98cfa9e9a0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:37.985191 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc787c-d5c6-4f11-b9f1-35ca8d977922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:37.985827 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc787c-d5c6-4f11-b9f1-35ca8d977922 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:37.986064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc787c-d5c6-4f11-b9f1-35ca8d977922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:37.986351 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc787c-d5c6-4f11-b9f1-35ca8d977922 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:37.986991 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc787c-d5c6-4f11-b9f1-35ca8d977922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:37.991082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc787c-d5c6-4f11-b9f1-35ca8d977922 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:38.018549 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1406/2839] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:46:37 2022] POST /identity/v3/users => generated 309 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:38.020258 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66467f4f-7706-40b0-a4b5-7f4761f24944 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:38.031177 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66467f4f-7706-40b0-a4b5-7f4761f24944 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:38.036500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5670-0c7d-434f-90c7-4500744d0780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:38.037187 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5670-0c7d-434f-90c7-4500744d0780 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:38.037553 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5670-0c7d-434f-90c7-4500744d0780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:38.037880 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5670-0c7d-434f-90c7-4500744d0780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:38.038596 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a5670-0c7d-434f-90c7-4500744d0780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:38.040293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a5670-0c7d-434f-90c7-4500744d0780 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:38.051981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1434/2840] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:46:38.056520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc787c-d5c6-4f11-b9f1-35ca8d977922 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:38.067480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc787c-d5c6-4f11-b9f1-35ca8d977922 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:38.073233 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2704d-5488-4fd0-a51c-6a69fcea49e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:38.073898 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2704d-5488-4fd0-a51c-6a69fcea49e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:38.074172 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2704d-5488-4fd0-a51c-6a69fcea49e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:38.074441 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2704d-5488-4fd0-a51c-6a69fcea49e4 admin admin] PATH_INFO: `/v3/projects/6112ac2554be48f092385863d77fe7cd/users/c83e3d3713ca4379b11616ea402b345e/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:38.090644 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2704d-5488-4fd0-a51c-6a69fcea49e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6112ac2554be48f092385863d77fe7cd, user_id=c83e3d3713ca4379b11616ea402b345e, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:38.093339 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2704d-5488-4fd0-a51c-6a69fcea49e4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:38.107959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1407/2841] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:46:38 2022] PUT /identity/v3/projects/6112ac2554be48f092385863d77fe7cd/users/c83e3d3713ca4379b11616ea402b345e/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:38.112240 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5670-0c7d-434f-90c7-4500744d0780 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:38.122158 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5670-0c7d-434f-90c7-4500744d0780 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:38.134124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:38.179899 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5683b-0e68-427f-aac5-0e2770030287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:38.180517 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5683b-0e68-427f-aac5-0e2770030287 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:38.180795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5683b-0e68-427f-aac5-0e2770030287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:38.181066 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5683b-0e68-427f-aac5-0e2770030287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:38.181718 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5683b-0e68-427f-aac5-0e2770030287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:38.183340 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5683b-0e68-427f-aac5-0e2770030287 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:38.193344 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1435/2842] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:46:38.198004 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2704d-5488-4fd0-a51c-6a69fcea49e4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:38.209017 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2704d-5488-4fd0-a51c-6a69fcea49e4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:38.214499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3faff0-81c5-4bec-8b48-1504fcf3fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:38.215182 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3faff0-81c5-4bec-8b48-1504fcf3fd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:38.215505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3faff0-81c5-4bec-8b48-1504fcf3fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:38.215781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3faff0-81c5-4bec-8b48-1504fcf3fd96 admin admin] PATH_INFO: `/v3/projects/6112ac2554be48f092385863d77fe7cd/users/c83e3d3713ca4379b11616ea402b345e/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:38.218013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3faff0-81c5-4bec-8b48-1504fcf3fd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6112ac2554be48f092385863d77fe7cd, user_id=c83e3d3713ca4379b11616ea402b345e, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:38.220728 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3faff0-81c5-4bec-8b48-1504fcf3fd96 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:38.231871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1408/2843] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:46:38 2022] PUT /identity/v3/projects/6112ac2554be48f092385863d77fe7cd/users/c83e3d3713ca4379b11616ea402b345e/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:38.867363 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0e6fa-f4a6-4b92-ae0f-e76f8b8f8cd8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:38.867706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0e6fa-f4a6-4b92-ae0f-e76f8b8f8cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:38.868044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0e6fa-f4a6-4b92-ae0f-e76f8b8f8cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:38.898270 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-94f0e6fa-f4a6-4b92-ae0f-e76f8b8f8cd8 None None] MFA Rules not processed for user `c83e3d3713ca4379b11616ea402b345e`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:38.899639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-94f0e6fa-f4a6-4b92-ae0f-e76f8b8f8cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:38.973712 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1436/2844] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:38 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:39.419905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3faff0-81c5-4bec-8b48-1504fcf3fd96 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:39.421842 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6a3faff0-81c5-4bec-8b48-1504fcf3fd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:39.505347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3faff0-81c5-4bec-8b48-1504fcf3fd96 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:39.510366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a3adc-48ca-4bcf-96e9-b4ec054124b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:39.511093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a3adc-48ca-4bcf-96e9-b4ec054124b2 service placement] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:39.511415 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a3adc-48ca-4bcf-96e9-b4ec054124b2 service placement] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:39.511682 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a3adc-48ca-4bcf-96e9-b4ec054124b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:39.513442 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7b6a3adc-48ca-4bcf-96e9-b4ec054124b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:39.525094 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a3adc-48ca-4bcf-96e9-b4ec054124b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:39.526665 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a3adc-48ca-4bcf-96e9-b4ec054124b2 service placement] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:39.532495 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:39.545009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1409/2845] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:46:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:46:40.001815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0e6fa-f4a6-4b92-ae0f-e76f8b8f8cd8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:40.063540 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0e6fa-f4a6-4b92-ae0f-e76f8b8f8cd8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:40.068507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:40.069140 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:40.069412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:40.069678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] PATH_INFO: `/v3/users/dedef7a88422483aa2c26e152dab1d32` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:40.070820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dedef7a88422483aa2c26e152dab1d32)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:40.072738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:40.120277 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:40.130452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dedef7a88422483aa2c26e152dab1d32'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.140261 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dedef7a88422483aa2c26e152dab1d32'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.152732 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dedef7a88422483aa2c26e152dab1d32'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.153418 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dedef7a88422483aa2c26e152dab1d32'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.161212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dedef7a88422483aa2c26e152dab1d32'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.167628 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1437/2846] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:46:40 2022] DELETE /identity/v3/users/dedef7a88422483aa2c26e152dab1d32 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:40.352967 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a3adc-48ca-4bcf-96e9-b4ec054124b2 service placement] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:40.365968 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a3adc-48ca-4bcf-96e9-b4ec054124b2 service placement] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:40.422118 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:40.422856 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:40.422963 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:40.423255 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] PATH_INFO: `/v3/projects/5776aa4cf33e4a03bcafd86204c4de0f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:40.424445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5776aa4cf33e4a03bcafd86204c4de0f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:40.426505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:40.473740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5776aa4cf33e4a03bcafd86204c4de0f', 'request_id': 'req-d317a9ec-5974-4332-b6d7-ca05ada73ca9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.480476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5776aa4cf33e4a03bcafd86204c4de0f', 'request_id': 'req-d317a9ec-5974-4332-b6d7-ca05ada73ca9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.486290 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5776aa4cf33e4a03bcafd86204c4de0f', 'request_id': 'req-d317a9ec-5974-4332-b6d7-ca05ada73ca9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.497216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] The token cache is being invalidate because project 5776aa4cf33e4a03bcafd86204c4de0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:46:40.497492 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.498125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.499661 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1410/2847] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:46:40 2022] DELETE /identity/v3/projects/5776aa4cf33e4a03bcafd86204c4de0f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:40.503797 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:40.505375 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:40.519348 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27aa31-59e5-44c0-9e2c-92b978350df4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:40.588588 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:40.589231 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:40.589507 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:40.589774 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] PATH_INFO: `/v3/users/c83e3d3713ca4379b11616ea402b345e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:40.591044 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83e3d3713ca4379b11616ea402b345e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:40.592985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:40.648188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83e3d3713ca4379b11616ea402b345e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.656913 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83e3d3713ca4379b11616ea402b345e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.669132 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83e3d3713ca4379b11616ea402b345e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.669770 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83e3d3713ca4379b11616ea402b345e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.676749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd9da7d0-aa46-43f1-b247-ef26eeab1eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83e3d3713ca4379b11616ea402b345e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:40.682647 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1438/2848] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:46:40 2022] DELETE /identity/v3/users/c83e3d3713ca4379b11616ea402b345e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:40.868668 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:40.871057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:40.888468 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317a9ec-5974-4332-b6d7-ca05ada73ca9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:40.949960 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:40.950599 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:40.950875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:40.951149 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] PATH_INFO: `/v3/projects/6112ac2554be48f092385863d77fe7cd` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:40.952307 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6112ac2554be48f092385863d77fe7cd)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:40.954219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:40.994810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:41.007874 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6112ac2554be48f092385863d77fe7cd', 'request_id': 'req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:41.015831 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6112ac2554be48f092385863d77fe7cd', 'request_id': 'req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:41.021740 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6112ac2554be48f092385863d77fe7cd', 'request_id': 'req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:41.032936 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] The token cache is being invalidate because project 6112ac2554be48f092385863d77fe7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:46:41.033236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:41.033925 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4c1348e-f3bc-4fa0-aa74-21a6de19c6b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:41.035650 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1411/2849] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:46:40 2022] DELETE /identity/v3/projects/6112ac2554be48f092385863d77fe7cd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:41.040674 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3974e-d608-4ba1-9c1e-10acf18df864 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.041142 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3974e-d608-4ba1-9c1e-10acf18df864 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.041241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3974e-d608-4ba1-9c1e-10acf18df864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.062243 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0fe3974e-d608-4ba1-9c1e-10acf18df864 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:41.063969 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0fe3974e-d608-4ba1-9c1e-10acf18df864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:41.095641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:41.125559 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1439/2850] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:41.133781 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e3d8-5f4d-4352-8ad2-71e96088c498 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.134081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e3d8-5f4d-4352-8ad2-71e96088c498 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.135039 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e3d8-5f4d-4352-8ad2-71e96088c498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.155701 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-72f9e3d8-5f4d-4352-8ad2-71e96088c498 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:41.156841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-72f9e3d8-5f4d-4352-8ad2-71e96088c498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:41.165027 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1412/2851] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:41.169427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3974e-d608-4ba1-9c1e-10acf18df864 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.179706 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3974e-d608-4ba1-9c1e-10acf18df864 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.185554 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff580b-f113-4aa6-b7c3-0021a50c87b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.186156 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff580b-f113-4aa6-b7c3-0021a50c87b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.186427 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff580b-f113-4aa6-b7c3-0021a50c87b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.186679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff580b-f113-4aa6-b7c3-0021a50c87b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.187336 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff580b-f113-4aa6-b7c3-0021a50c87b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:46:41.187662 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff580b-f113-4aa6-b7c3-0021a50c87b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.189252 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff580b-f113-4aa6-b7c3-0021a50c87b5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:41.201280 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1440/2852] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:46:41.205912 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9e3d8-5f4d-4352-8ad2-71e96088c498 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.216655 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9e3d8-5f4d-4352-8ad2-71e96088c498 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.222719 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e904f-e1e7-4b63-b25f-e9ba7e6b2567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.223347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e904f-e1e7-4b63-b25f-e9ba7e6b2567 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.223631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e904f-e1e7-4b63-b25f-e9ba7e6b2567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.223903 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e904f-e1e7-4b63-b25f-e9ba7e6b2567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.224539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e904f-e1e7-4b63-b25f-e9ba7e6b2567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.226459 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e904f-e1e7-4b63-b25f-e9ba7e6b2567 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:41.259045 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1413/2853] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:46:41 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:41.265733 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff580b-f113-4aa6-b7c3-0021a50c87b5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.277306 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff580b-f113-4aa6-b7c3-0021a50c87b5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.338235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d98dd-d4c1-4a82-92aa-7dfefb71634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.338851 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d98dd-d4c1-4a82-92aa-7dfefb71634c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.339118 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d98dd-d4c1-4a82-92aa-7dfefb71634c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.339440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d98dd-d4c1-4a82-92aa-7dfefb71634c admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.340078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d98dd-d4c1-4a82-92aa-7dfefb71634c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.341970 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d98dd-d4c1-4a82-92aa-7dfefb71634c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:41.364663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1441/2854] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:46:41 2022] POST /identity/v3/users => generated 279 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:41.368879 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e904f-e1e7-4b63-b25f-e9ba7e6b2567 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.380009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e904f-e1e7-4b63-b25f-e9ba7e6b2567 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.385328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6603-cb8a-4ea7-8c50-57e13aae88f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.385930 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6603-cb8a-4ea7-8c50-57e13aae88f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.386208 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6603-cb8a-4ea7-8c50-57e13aae88f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.386483 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6603-cb8a-4ea7-8c50-57e13aae88f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.387128 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e6603-cb8a-4ea7-8c50-57e13aae88f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.388779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e6603-cb8a-4ea7-8c50-57e13aae88f2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:41.399133 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1414/2855] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:46:41.403333 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d98dd-d4c1-4a82-92aa-7dfefb71634c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.413951 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d98dd-d4c1-4a82-92aa-7dfefb71634c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.419574 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d8ed6-e6cf-4662-b5a0-9e566d12aaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.420212 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8ed6-e6cf-4662-b5a0-9e566d12aaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.420484 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8ed6-e6cf-4662-b5a0-9e566d12aaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.420753 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8ed6-e6cf-4662-b5a0-9e566d12aaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.421408 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d8ed6-e6cf-4662-b5a0-9e566d12aaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.422988 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d8ed6-e6cf-4662-b5a0-9e566d12aaa5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:41.434822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1442/2856] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:46:41.439216 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6603-cb8a-4ea7-8c50-57e13aae88f2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.449169 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6603-cb8a-4ea7-8c50-57e13aae88f2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.453984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf7818-a58a-4a0f-9444-20ef6191ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.454632 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf7818-a58a-4a0f-9444-20ef6191ff24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.454908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf7818-a58a-4a0f-9444-20ef6191ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.455174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf7818-a58a-4a0f-9444-20ef6191ff24 admin admin] PATH_INFO: `/v3/projects/b10e43047ffc47f5af1885375581ed27/users/b48ad75ddcd246608ad9c5ea577d3b07/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.470050 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf7818-a58a-4a0f-9444-20ef6191ff24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10e43047ffc47f5af1885375581ed27, user_id=b48ad75ddcd246608ad9c5ea577d3b07, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.472916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf7818-a58a-4a0f-9444-20ef6191ff24 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:41.487702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1415/2857] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:46:41 2022] PUT /identity/v3/projects/b10e43047ffc47f5af1885375581ed27/users/b48ad75ddcd246608ad9c5ea577d3b07/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:41.499421 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af15e9-c975-4cd6-a5de-e3f58e8579e4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.499708 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af15e9-c975-4cd6-a5de-e3f58e8579e4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.499961 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af15e9-c975-4cd6-a5de-e3f58e8579e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.528997 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b1af15e9-c975-4cd6-a5de-e3f58e8579e4 None None] MFA Rules not processed for user `b48ad75ddcd246608ad9c5ea577d3b07`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:41.530235 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b1af15e9-c975-4cd6-a5de-e3f58e8579e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:41.596221 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1443/2858] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:41.601131 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf7818-a58a-4a0f-9444-20ef6191ff24 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.671854 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf7818-a58a-4a0f-9444-20ef6191ff24 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.677130 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c289c92-9f54-41a5-a66f-d631d9f5be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.677729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289c92-9f54-41a5-a66f-d631d9f5be52 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.678008 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289c92-9f54-41a5-a66f-d631d9f5be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.678274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289c92-9f54-41a5-a66f-d631d9f5be52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.678904 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c289c92-9f54-41a5-a66f-d631d9f5be52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.680907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c289c92-9f54-41a5-a66f-d631d9f5be52 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:41.710586 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1416/2859] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:46:41 2022] POST /identity/v3/projects => generated 353 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:41.714890 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af15e9-c975-4cd6-a5de-e3f58e8579e4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.725847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af15e9-c975-4cd6-a5de-e3f58e8579e4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.755627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:41.787441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3138a53-a664-4b48-bfbb-ac35dc685e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.788068 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3138a53-a664-4b48-bfbb-ac35dc685e16 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.788326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3138a53-a664-4b48-bfbb-ac35dc685e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.788591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3138a53-a664-4b48-bfbb-ac35dc685e16 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.789230 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3138a53-a664-4b48-bfbb-ac35dc685e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.791119 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3138a53-a664-4b48-bfbb-ac35dc685e16 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:41.813775 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1444/2860] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:46:41 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:46:41.818156 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c289c92-9f54-41a5-a66f-d631d9f5be52 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.828720 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c289c92-9f54-41a5-a66f-d631d9f5be52 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.833841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa688734-af3d-4fa4-9a3f-ab662c8742e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.834449 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688734-af3d-4fa4-9a3f-ab662c8742e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.834724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688734-af3d-4fa4-9a3f-ab662c8742e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.834990 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688734-af3d-4fa4-9a3f-ab662c8742e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.835696 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa688734-af3d-4fa4-9a3f-ab662c8742e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.837288 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa688734-af3d-4fa4-9a3f-ab662c8742e2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:41.848119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1417/2861] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:46:41.852465 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3138a53-a664-4b48-bfbb-ac35dc685e16 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.863249 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3138a53-a664-4b48-bfbb-ac35dc685e16 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.868526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06697a6-0389-4605-ada4-fecbbbd3c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.869178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06697a6-0389-4605-ada4-fecbbbd3c9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.869435 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06697a6-0389-4605-ada4-fecbbbd3c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.869707 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06697a6-0389-4605-ada4-fecbbbd3c9b0 admin admin] PATH_INFO: `/v3/projects/038317d2656142c3894846be2f88c583/users/79496a83b95d461ebd1cacf73c645c61/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.886565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06697a6-0389-4605-ada4-fecbbbd3c9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038317d2656142c3894846be2f88c583, user_id=79496a83b95d461ebd1cacf73c645c61, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.889259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06697a6-0389-4605-ada4-fecbbbd3c9b0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:41.908734 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1445/2862] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:46:41 2022] PUT /identity/v3/projects/038317d2656142c3894846be2f88c583/users/79496a83b95d461ebd1cacf73c645c61/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 04:46:41.912959 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa688734-af3d-4fa4-9a3f-ab662c8742e2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:41.924127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa688734-af3d-4fa4-9a3f-ab662c8742e2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:41.956947 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:41.993404 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eea2f3-9ebd-4bdc-84ec-b9e1895d1432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:41.994023 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea2f3-9ebd-4bdc-84ec-b9e1895d1432 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:41.994286 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea2f3-9ebd-4bdc-84ec-b9e1895d1432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:41.994548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea2f3-9ebd-4bdc-84ec-b9e1895d1432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:41.995190 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eea2f3-9ebd-4bdc-84ec-b9e1895d1432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:41.996845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eea2f3-9ebd-4bdc-84ec-b9e1895d1432 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:42.007086 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1418/2863] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:46:42.011373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06697a6-0389-4605-ada4-fecbbbd3c9b0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:42.022977 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06697a6-0389-4605-ada4-fecbbbd3c9b0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:42.030562 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfd01b-a1c1-43ee-8ecb-6a47ff749b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:42.031673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfd01b-a1c1-43ee-8ecb-6a47ff749b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:42.032019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfd01b-a1c1-43ee-8ecb-6a47ff749b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:42.032367 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfd01b-a1c1-43ee-8ecb-6a47ff749b03 admin admin] PATH_INFO: `/v3/projects/038317d2656142c3894846be2f88c583/users/79496a83b95d461ebd1cacf73c645c61/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:42.035522 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfd01b-a1c1-43ee-8ecb-6a47ff749b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038317d2656142c3894846be2f88c583, user_id=79496a83b95d461ebd1cacf73c645c61, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:42.039380 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfd01b-a1c1-43ee-8ecb-6a47ff749b03 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:42.054314 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1446/2864] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:46:42 2022] PUT /identity/v3/projects/038317d2656142c3894846be2f88c583/users/79496a83b95d461ebd1cacf73c645c61/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:42.064817 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5eff7-5594-479e-a1ed-95cdaa40be94 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:42.065098 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5eff7-5594-479e-a1ed-95cdaa40be94 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:42.065402 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5eff7-5594-479e-a1ed-95cdaa40be94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:42.097412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e5c5eff7-5594-479e-a1ed-95cdaa40be94 None None] MFA Rules not processed for user `79496a83b95d461ebd1cacf73c645c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:42.098762 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e5c5eff7-5594-479e-a1ed-95cdaa40be94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:42.176767 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1419/2865] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:42.188329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfd01b-a1c1-43ee-8ecb-6a47ff749b03 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:42.190412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-55cfd01b-a1c1-43ee-8ecb-6a47ff749b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:42.249247 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfd01b-a1c1-43ee-8ecb-6a47ff749b03 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:42.253080 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554899b3-b0b7-43b2-9c64-43c8160e205c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:42.253955 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554899b3-b0b7-43b2-9c64-43c8160e205c service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:42.254241 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554899b3-b0b7-43b2-9c64-43c8160e205c service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:42.254491 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554899b3-b0b7-43b2-9c64-43c8160e205c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:42.263710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554899b3-b0b7-43b2-9c64-43c8160e205c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:42.265139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554899b3-b0b7-43b2-9c64-43c8160e205c service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:42.275000 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1447/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:46:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:46:42.358328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5eff7-5594-479e-a1ed-95cdaa40be94 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:42.369299 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5eff7-5594-479e-a1ed-95cdaa40be94 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:42.373659 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f648c04-4e88-4e76-947a-f1c4b31ea7ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:42.374277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f648c04-4e88-4e76-947a-f1c4b31ea7ec service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:42.374555 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f648c04-4e88-4e76-947a-f1c4b31ea7ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:42.374825 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f648c04-4e88-4e76-947a-f1c4b31ea7ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:42.432980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f648c04-4e88-4e76-947a-f1c4b31ea7ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:42.434321 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f648c04-4e88-4e76-947a-f1c4b31ea7ec service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:42.443704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1420/2867] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:46:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:46:52.270543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=56,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:52.439731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=77 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:57.731847 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554899b3-b0b7-43b2-9c64-43c8160e205c service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:57.795879 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554899b3-b0b7-43b2-9c64-43c8160e205c service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:57.800801 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:57.801437 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:57.801713 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:57.801982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] PATH_INFO: `/v3/users/b48ad75ddcd246608ad9c5ea577d3b07` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:57.803143 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48ad75ddcd246608ad9c5ea577d3b07)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:57.805086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:57.852845 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48ad75ddcd246608ad9c5ea577d3b07'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:57.864026 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48ad75ddcd246608ad9c5ea577d3b07'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:57.876748 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48ad75ddcd246608ad9c5ea577d3b07'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:57.877417 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48ad75ddcd246608ad9c5ea577d3b07'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:57.885079 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48ad75ddcd246608ad9c5ea577d3b07'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:57.891175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1448/2868] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:46:57 2022] DELETE /identity/v3/users/b48ad75ddcd246608ad9c5ea577d3b07 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:57.896009 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4c142-e4fa-4801-b3e2-d59ff1db42fe None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:57.896505 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4c142-e4fa-4801-b3e2-d59ff1db42fe None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:57.896603 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4c142-e4fa-4801-b3e2-d59ff1db42fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:57.916892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1ab4c142-e4fa-4801-b3e2-d59ff1db42fe None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:57.918089 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1ab4c142-e4fa-4801-b3e2-d59ff1db42fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:57.978336 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1421/2869] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:46:57.988615 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:57.990141 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:58.051763 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c29425-92b7-42bf-b7d5-87811952ac73 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:58.056546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be0fc6-606d-4db3-9b68-0e54320dbed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:58.057157 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be0fc6-606d-4db3-9b68-0e54320dbed6 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:58.057440 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be0fc6-606d-4db3-9b68-0e54320dbed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:58.057693 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be0fc6-606d-4db3-9b68-0e54320dbed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:58.067259 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be0fc6-606d-4db3-9b68-0e54320dbed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:58.068744 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be0fc6-606d-4db3-9b68-0e54320dbed6 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:58.078682 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1449/2870] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:46:58.368577 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4c142-e4fa-4801-b3e2-d59ff1db42fe None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:58.370164 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1ab4c142-e4fa-4801-b3e2-d59ff1db42fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:58.384967 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4c142-e4fa-4801-b3e2-d59ff1db42fe None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:58.390471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:58.391282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:58.391598 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:58.391852 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] PATH_INFO: `/v3/projects/b10e43047ffc47f5af1885375581ed27` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:58.392987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10e43047ffc47f5af1885375581ed27)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:58.394880 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:58.445646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10e43047ffc47f5af1885375581ed27', 'request_id': 'req-49bc28c0-6848-4a07-9ba4-6f4228c95822'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:58.455772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10e43047ffc47f5af1885375581ed27', 'request_id': 'req-49bc28c0-6848-4a07-9ba4-6f4228c95822'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:58.462734 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10e43047ffc47f5af1885375581ed27', 'request_id': 'req-49bc28c0-6848-4a07-9ba4-6f4228c95822'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:58.473908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] The token cache is being invalidate because project b10e43047ffc47f5af1885375581ed27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:46:58.474187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:58.474841 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:58.476363 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1422/2871] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:46:58 2022] DELETE /identity/v3/projects/b10e43047ffc47f5af1885375581ed27 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:58.480526 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be0fc6-606d-4db3-9b68-0e54320dbed6 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:58.490992 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be0fc6-606d-4db3-9b68-0e54320dbed6 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:58.514738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:58.557512 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:58.558110 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:58.558385 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:58.558634 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] PATH_INFO: `/v3/users/79496a83b95d461ebd1cacf73c645c61` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:58.559882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=79496a83b95d461ebd1cacf73c645c61)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:58.561792 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:58.613871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79496a83b95d461ebd1cacf73c645c61'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:58.622321 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79496a83b95d461ebd1cacf73c645c61'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:58.634123 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79496a83b95d461ebd1cacf73c645c61'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:58.634746 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79496a83b95d461ebd1cacf73c645c61'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:58.641756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5eb1ba81-4052-4d9d-ac34-adb0ad522ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79496a83b95d461ebd1cacf73c645c61'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:58.648133 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1450/2872] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:46:58 2022] DELETE /identity/v3/users/79496a83b95d461ebd1cacf73c645c61 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:58.935615 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:58.937147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:58.951161 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc28c0-6848-4a07-9ba4-6f4228c95822 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:59.009797 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:59.010436 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.010711 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.010983 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] PATH_INFO: `/v3/projects/038317d2656142c3894846be2f88c583` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.012236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=038317d2656142c3894846be2f88c583)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:59.014183 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:59.053304 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:59.072160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038317d2656142c3894846be2f88c583', 'request_id': 'req-17511345-fab1-4650-bf9d-2baa0ad63339'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:59.081815 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038317d2656142c3894846be2f88c583', 'request_id': 'req-17511345-fab1-4650-bf9d-2baa0ad63339'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:59.087479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038317d2656142c3894846be2f88c583', 'request_id': 'req-17511345-fab1-4650-bf9d-2baa0ad63339'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:59.098209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] The token cache is being invalidate because project 038317d2656142c3894846be2f88c583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:46:59.098489 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:59.099125 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-17511345-fab1-4650-bf9d-2baa0ad63339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:46:59.100648 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1423/2873] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:46:58 2022] DELETE /identity/v3/projects/038317d2656142c3894846be2f88c583 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:59.106488 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608fcd-2859-4e74-a782-8b878d1e43fc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.107004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608fcd-2859-4e74-a782-8b878d1e43fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.107004 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608fcd-2859-4e74-a782-8b878d1e43fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.128180 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9b608fcd-2859-4e74-a782-8b878d1e43fc None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:59.129432 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9b608fcd-2859-4e74-a782-8b878d1e43fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:59.191175 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1451/2874] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:59.200315 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62d130-80d1-471d-8ad1-f3ddc00122c5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.200594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62d130-80d1-471d-8ad1-f3ddc00122c5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.200871 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62d130-80d1-471d-8ad1-f3ddc00122c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.221058 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2e62d130-80d1-471d-8ad1-f3ddc00122c5 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:59.222253 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2e62d130-80d1-471d-8ad1-f3ddc00122c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:59.231080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1424/2875] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:46:59.235831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608fcd-2859-4e74-a782-8b878d1e43fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:59.246281 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608fcd-2859-4e74-a782-8b878d1e43fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:59.252074 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99668c4c-2d22-45ed-b265-a2a5614c974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:59.252681 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99668c4c-2d22-45ed-b265-a2a5614c974c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.252960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99668c4c-2d22-45ed-b265-a2a5614c974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.253232 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99668c4c-2d22-45ed-b265-a2a5614c974c admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.253891 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99668c4c-2d22-45ed-b265-a2a5614c974c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:46:59.254238 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99668c4c-2d22-45ed-b265-a2a5614c974c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:59.255871 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99668c4c-2d22-45ed-b265-a2a5614c974c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:59.268354 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1452/2876] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:46:59.272513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62d130-80d1-471d-8ad1-f3ddc00122c5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:59.281928 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62d130-80d1-471d-8ad1-f3ddc00122c5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:59.287007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fb54a-3d24-41d9-b543-997abd339936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:59.287633 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fb54a-3d24-41d9-b543-997abd339936 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.287892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fb54a-3d24-41d9-b543-997abd339936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.288167 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fb54a-3d24-41d9-b543-997abd339936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.288820 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fb54a-3d24-41d9-b543-997abd339936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:59.290789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fb54a-3d24-41d9-b543-997abd339936 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:59.320769 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1425/2877] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:46:59 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:59.325313 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99668c4c-2d22-45ed-b265-a2a5614c974c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:59.335580 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99668c4c-2d22-45ed-b265-a2a5614c974c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:59.362372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:59.395953 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e8111-55dc-4210-8592-90257d3ebcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:59.396603 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e8111-55dc-4210-8592-90257d3ebcc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.396882 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e8111-55dc-4210-8592-90257d3ebcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.397139 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e8111-55dc-4210-8592-90257d3ebcc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.397787 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e8111-55dc-4210-8592-90257d3ebcc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:59.399832 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e8111-55dc-4210-8592-90257d3ebcc9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:59.422685 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1453/2878] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:46:59 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:59.427000 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fb54a-3d24-41d9-b543-997abd339936 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:59.442185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fb54a-3d24-41d9-b543-997abd339936 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:59.447543 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307190f5-4cec-487e-a4e6-7e66de907b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:59.448143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307190f5-4cec-487e-a4e6-7e66de907b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.448414 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307190f5-4cec-487e-a4e6-7e66de907b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.448680 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307190f5-4cec-487e-a4e6-7e66de907b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.449324 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307190f5-4cec-487e-a4e6-7e66de907b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:59.450926 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307190f5-4cec-487e-a4e6-7e66de907b46 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:59.462162 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1426/2879] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 04:46:59.466464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e8111-55dc-4210-8592-90257d3ebcc9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:59.476978 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e8111-55dc-4210-8592-90257d3ebcc9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:59.483239 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78ff0-9c25-4180-a783-9e35888f497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:59.484251 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78ff0-9c25-4180-a783-9e35888f497d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.484571 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78ff0-9c25-4180-a783-9e35888f497d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.484866 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78ff0-9c25-4180-a783-9e35888f497d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.485659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78ff0-9c25-4180-a783-9e35888f497d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:59.488238 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78ff0-9c25-4180-a783-9e35888f497d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:59.500679 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1454/2880] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:46:59.505350 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307190f5-4cec-487e-a4e6-7e66de907b46 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:59.515748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307190f5-4cec-487e-a4e6-7e66de907b46 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:59.520694 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469a3cd-bc23-472a-9f72-f2c9d2bf7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:59.521361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469a3cd-bc23-472a-9f72-f2c9d2bf7214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.521640 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469a3cd-bc23-472a-9f72-f2c9d2bf7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.521905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469a3cd-bc23-472a-9f72-f2c9d2bf7214 admin admin] PATH_INFO: `/v3/projects/216879b21eee408ab835228e1d43b7e0/users/aba6cb6561aa4a35a38883dfe5d10b22/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.536987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469a3cd-bc23-472a-9f72-f2c9d2bf7214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216879b21eee408ab835228e1d43b7e0, user_id=aba6cb6561aa4a35a38883dfe5d10b22, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:59.539651 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469a3cd-bc23-472a-9f72-f2c9d2bf7214 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:59.554070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1427/2881] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:46:59 2022] PUT /identity/v3/projects/216879b21eee408ab835228e1d43b7e0/users/aba6cb6561aa4a35a38883dfe5d10b22/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:46:59.620185 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f43a-644f-4374-b320-8aac6791d3de None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.620428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f43a-644f-4374-b320-8aac6791d3de None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.620742 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f43a-644f-4374-b320-8aac6791d3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.654506 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-acc1f43a-644f-4374-b320-8aac6791d3de None None] MFA Rules not processed for user `aba6cb6561aa4a35a38883dfe5d10b22`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:46:59.655762 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-acc1f43a-644f-4374-b320-8aac6791d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:46:59.728203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1455/2882] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:46:59.733064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469a3cd-bc23-472a-9f72-f2c9d2bf7214 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:59.799779 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469a3cd-bc23-472a-9f72-f2c9d2bf7214 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:59.808188 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc918e1-517a-46e8-b78f-73c84e461db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:59.808797 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc918e1-517a-46e8-b78f-73c84e461db0 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.809064 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc918e1-517a-46e8-b78f-73c84e461db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.809328 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc918e1-517a-46e8-b78f-73c84e461db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.809954 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc918e1-517a-46e8-b78f-73c84e461db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:59.811875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc918e1-517a-46e8-b78f-73c84e461db0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:59.841882 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1428/2883] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:46:59 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:59.846127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f43a-644f-4374-b320-8aac6791d3de None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:59.857422 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f43a-644f-4374-b320-8aac6791d3de None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:59.914908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a30b6-0d16-4f28-a9f4-ae70e0f9772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:59.915646 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a30b6-0d16-4f28-a9f4-ae70e0f9772c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.915900 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a30b6-0d16-4f28-a9f4-ae70e0f9772c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.916192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a30b6-0d16-4f28-a9f4-ae70e0f9772c admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.916821 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a30b6-0d16-4f28-a9f4-ae70e0f9772c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:59.918723 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a30b6-0d16-4f28-a9f4-ae70e0f9772c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:59.939931 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1456/2884] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:46:59 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:46:59.944071 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc918e1-517a-46e8-b78f-73c84e461db0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:59.955088 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc918e1-517a-46e8-b78f-73c84e461db0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:46:59.960412 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193647ae-fa0e-4ff7-bc76-318e058ebf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:46:59.961010 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193647ae-fa0e-4ff7-bc76-318e058ebf14 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:46:59.961282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193647ae-fa0e-4ff7-bc76-318e058ebf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:46:59.961544 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193647ae-fa0e-4ff7-bc76-318e058ebf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:46:59.962180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193647ae-fa0e-4ff7-bc76-318e058ebf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:46:59.963837 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193647ae-fa0e-4ff7-bc76-318e058ebf14 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:46:59.976067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1429/2885] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:46:59.980829 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a30b6-0d16-4f28-a9f4-ae70e0f9772c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:46:59.996166 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a30b6-0d16-4f28-a9f4-ae70e0f9772c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:00.005081 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779854a-dfe7-416d-aeba-6e92f94a99a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:00.006029 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779854a-dfe7-416d-aeba-6e92f94a99a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:00.006372 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779854a-dfe7-416d-aeba-6e92f94a99a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:00.006688 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779854a-dfe7-416d-aeba-6e92f94a99a3 admin admin] PATH_INFO: `/v3/projects/1bbba74d7406453abb63ad2314e3b7af/users/8aeae327fd4f42fb86a33bde21f64086/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:00.024112 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779854a-dfe7-416d-aeba-6e92f94a99a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbba74d7406453abb63ad2314e3b7af, user_id=8aeae327fd4f42fb86a33bde21f64086, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:00.026752 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779854a-dfe7-416d-aeba-6e92f94a99a3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:00.042898 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1457/2886] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:46:59 2022] PUT /identity/v3/projects/1bbba74d7406453abb63ad2314e3b7af/users/8aeae327fd4f42fb86a33bde21f64086/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:00.046935 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193647ae-fa0e-4ff7-bc76-318e058ebf14 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:00.057034 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193647ae-fa0e-4ff7-bc76-318e058ebf14 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:00.077332 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:00.117059 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b8a84-2778-4aed-8853-54df993fd90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:00.117590 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8a84-2778-4aed-8853-54df993fd90f admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:00.117863 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8a84-2778-4aed-8853-54df993fd90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:00.118136 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8a84-2778-4aed-8853-54df993fd90f admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:00.118813 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b8a84-2778-4aed-8853-54df993fd90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:00.120487 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b8a84-2778-4aed-8853-54df993fd90f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:00.130914 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1430/2887] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:47:00.135496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779854a-dfe7-416d-aeba-6e92f94a99a3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:00.141064 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:00.147352 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779854a-dfe7-416d-aeba-6e92f94a99a3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:00.153822 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b473e-0c5b-4e2a-92a7-d0d45faa7707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:00.154487 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b473e-0c5b-4e2a-92a7-d0d45faa7707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:00.154768 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b473e-0c5b-4e2a-92a7-d0d45faa7707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:00.155047 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b473e-0c5b-4e2a-92a7-d0d45faa7707 admin admin] PATH_INFO: `/v3/projects/1bbba74d7406453abb63ad2314e3b7af/users/8aeae327fd4f42fb86a33bde21f64086/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:00.157145 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b473e-0c5b-4e2a-92a7-d0d45faa7707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbba74d7406453abb63ad2314e3b7af, user_id=8aeae327fd4f42fb86a33bde21f64086, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:00.159892 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b473e-0c5b-4e2a-92a7-d0d45faa7707 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:00.172799 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1458/2888] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:47:00 2022] PUT /identity/v3/projects/1bbba74d7406453abb63ad2314e3b7af/users/8aeae327fd4f42fb86a33bde21f64086/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:00.183330 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694eac3-d484-4e8f-a016-00265efd9b71 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:00.183621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694eac3-d484-4e8f-a016-00265efd9b71 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:00.183889 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694eac3-d484-4e8f-a016-00265efd9b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:00.213104 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a694eac3-d484-4e8f-a016-00265efd9b71 None None] MFA Rules not processed for user `8aeae327fd4f42fb86a33bde21f64086`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:00.214298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a694eac3-d484-4e8f-a016-00265efd9b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:00.286907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1431/2889] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:00.298644 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b473e-0c5b-4e2a-92a7-d0d45faa7707 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:00.300510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-623b473e-0c5b-4e2a-92a7-d0d45faa7707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:00.373984 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b473e-0c5b-4e2a-92a7-d0d45faa7707 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:00.378328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637e238-6091-4c4a-b416-09427a86b525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:00.378929 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637e238-6091-4c4a-b416-09427a86b525 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:00.379203 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637e238-6091-4c4a-b416-09427a86b525 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:00.379505 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637e238-6091-4c4a-b416-09427a86b525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:00.388641 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637e238-6091-4c4a-b416-09427a86b525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:00.390104 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637e238-6091-4c4a-b416-09427a86b525 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:00.399667 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1459/2890] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:47:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:47:00.448155 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694eac3-d484-4e8f-a016-00265efd9b71 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:00.449588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a694eac3-d484-4e8f-a016-00265efd9b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:00.462173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694eac3-d484-4e8f-a016-00265efd9b71 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:00.466119 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bb989-9117-433f-a7af-156c2bfdffa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:00.466716 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bb989-9117-433f-a7af-156c2bfdffa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:00.466984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bb989-9117-433f-a7af-156c2bfdffa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:00.467250 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bb989-9117-433f-a7af-156c2bfdffa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:00.526236 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bb989-9117-433f-a7af-156c2bfdffa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:00.527731 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bb989-9117-433f-a7af-156c2bfdffa3 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:00.536614 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1432/2891] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:47:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:47:03.965696 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637e238-6091-4c4a-b416-09427a86b525 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:04.040783 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637e238-6091-4c4a-b416-09427a86b525 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:04.046072 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:04.046710 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:04.046980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:04.047253 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] PATH_INFO: `/v3/users/aba6cb6561aa4a35a38883dfe5d10b22` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:04.048528 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba6cb6561aa4a35a38883dfe5d10b22)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:04.050452 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:04.114741 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba6cb6561aa4a35a38883dfe5d10b22'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.124736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba6cb6561aa4a35a38883dfe5d10b22'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.141883 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba6cb6561aa4a35a38883dfe5d10b22'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.142714 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba6cb6561aa4a35a38883dfe5d10b22'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.153155 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba6cb6561aa4a35a38883dfe5d10b22'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.159923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1460/2892] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:47:03 2022] DELETE /identity/v3/users/aba6cb6561aa4a35a38883dfe5d10b22 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:04.165006 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2992905-0b8c-4b77-ba6c-1efef77fa36c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:04.165501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2992905-0b8c-4b77-ba6c-1efef77fa36c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:04.165501 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2992905-0b8c-4b77-ba6c-1efef77fa36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:04.189961 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f2992905-0b8c-4b77-ba6c-1efef77fa36c None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:04.191278 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f2992905-0b8c-4b77-ba6c-1efef77fa36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:04.245621 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:04.274513 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1433/2893] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:04.291412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:04.294964 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:04.310215 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:04.363795 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c1fbf-3f7d-4a55-81ac-164ecf5dd978 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:04.368901 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55585485-8413-4f56-ae83-2438f665082f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:04.369455 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55585485-8413-4f56-ae83-2438f665082f service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:04.369728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55585485-8413-4f56-ae83-2438f665082f service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:04.369995 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55585485-8413-4f56-ae83-2438f665082f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:04.382711 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55585485-8413-4f56-ae83-2438f665082f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:04.385186 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55585485-8413-4f56-ae83-2438f665082f service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:04.397808 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1461/2894] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:47:04.728095 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2992905-0b8c-4b77-ba6c-1efef77fa36c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:04.729690 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f2992905-0b8c-4b77-ba6c-1efef77fa36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:04.746281 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2992905-0b8c-4b77-ba6c-1efef77fa36c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:04.753127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:04.754423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:04.754700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:04.754971 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] PATH_INFO: `/v3/projects/216879b21eee408ab835228e1d43b7e0` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:04.756285 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] RBAC: Authorizing `identity:delete_project(project_id=216879b21eee408ab835228e1d43b7e0)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:04.760347 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:04.813209 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216879b21eee408ab835228e1d43b7e0', 'request_id': 'req-3e0c67ec-e8d0-447b-b8bd-3037b434491d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.824700 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216879b21eee408ab835228e1d43b7e0', 'request_id': 'req-3e0c67ec-e8d0-447b-b8bd-3037b434491d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.830345 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216879b21eee408ab835228e1d43b7e0', 'request_id': 'req-3e0c67ec-e8d0-447b-b8bd-3037b434491d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.841774 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] The token cache is being invalidate because project 216879b21eee408ab835228e1d43b7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:47:04.842057 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.842855 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.844578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1434/2895] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:47:04 2022] DELETE /identity/v3/projects/216879b21eee408ab835228e1d43b7e0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:04.850542 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55585485-8413-4f56-ae83-2438f665082f service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:04.861148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55585485-8413-4f56-ae83-2438f665082f service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:04.921791 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:04.922334 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:04.922721 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:04.922941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] PATH_INFO: `/v3/users/8aeae327fd4f42fb86a33bde21f64086` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:04.924287 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aeae327fd4f42fb86a33bde21f64086)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:04.926311 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:04.986329 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aeae327fd4f42fb86a33bde21f64086'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:04.996149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aeae327fd4f42fb86a33bde21f64086'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:05.008189 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aeae327fd4f42fb86a33bde21f64086'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:05.008815 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aeae327fd4f42fb86a33bde21f64086'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:05.015709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5c0e9154-525b-4677-9526-99e077a9a6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aeae327fd4f42fb86a33bde21f64086'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:05.021919 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1462/2896] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:47:04 2022] DELETE /identity/v3/users/8aeae327fd4f42fb86a33bde21f64086 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:05.292594 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:05.294366 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:05.313760 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c67ec-e8d0-447b-b8bd-3037b434491d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:05.375231 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:05.375975 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:05.376251 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:05.376520 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] PATH_INFO: `/v3/projects/1bbba74d7406453abb63ad2314e3b7af` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:05.377631 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbba74d7406453abb63ad2314e3b7af)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:05.379574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:05.431258 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbba74d7406453abb63ad2314e3b7af', 'request_id': 'req-b42fbcb1-2959-4075-9305-4a598fc3667d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:05.439809 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbba74d7406453abb63ad2314e3b7af', 'request_id': 'req-b42fbcb1-2959-4075-9305-4a598fc3667d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:05.447293 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbba74d7406453abb63ad2314e3b7af', 'request_id': 'req-b42fbcb1-2959-4075-9305-4a598fc3667d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:05.454605 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:05.460791 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] The token cache is being invalidate because project 1bbba74d7406453abb63ad2314e3b7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:47:05.461273 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:05.462160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b42fbcb1-2959-4075-9305-4a598fc3667d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:05.463907 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1435/2897] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:47:05 2022] DELETE /identity/v3/projects/1bbba74d7406453abb63ad2314e3b7af => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:05.469678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f49470-e1ca-4943-9411-ac369fffe8be None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:05.469980 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f49470-e1ca-4943-9411-ac369fffe8be None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:05.470260 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f49470-e1ca-4943-9411-ac369fffe8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:05.494598 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c5f49470-e1ca-4943-9411-ac369fffe8be None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:05.495857 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c5f49470-e1ca-4943-9411-ac369fffe8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:05.529086 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:05.564317 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1463/2898] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:47:05.574127 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c16ff-b9a5-48b1-807a-3ab007df3001 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:05.574399 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c16ff-b9a5-48b1-807a-3ab007df3001 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:05.574869 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c16ff-b9a5-48b1-807a-3ab007df3001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:05.597623 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-fd1c16ff-b9a5-48b1-807a-3ab007df3001 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:05.598828 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fd1c16ff-b9a5-48b1-807a-3ab007df3001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:05.608875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1436/2899] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:05.613586 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f49470-e1ca-4943-9411-ac369fffe8be None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:05.624165 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f49470-e1ca-4943-9411-ac369fffe8be None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:05.630150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5f7ec-d89e-491d-85ca-3937e64e7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:05.630756 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5f7ec-d89e-491d-85ca-3937e64e7a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:05.631030 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5f7ec-d89e-491d-85ca-3937e64e7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:05.631293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5f7ec-d89e-491d-85ca-3937e64e7a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:05.631982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5f7ec-d89e-491d-85ca-3937e64e7a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:47:05.632279 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5f7ec-d89e-491d-85ca-3937e64e7a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:05.633884 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5f7ec-d89e-491d-85ca-3937e64e7a19 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:05.646640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1464/2900] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:47:05.651506 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c16ff-b9a5-48b1-807a-3ab007df3001 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:05.664635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c16ff-b9a5-48b1-807a-3ab007df3001 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:05.670741 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abdfa9-dcaa-49d1-9ec2-0454f3af065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:05.671357 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdfa9-dcaa-49d1-9ec2-0454f3af065b admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:05.671664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdfa9-dcaa-49d1-9ec2-0454f3af065b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:05.671905 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdfa9-dcaa-49d1-9ec2-0454f3af065b admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:05.672545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abdfa9-dcaa-49d1-9ec2-0454f3af065b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:05.674721 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abdfa9-dcaa-49d1-9ec2-0454f3af065b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:05.707298 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1437/2901] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:47:05 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:47:05.711521 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5f7ec-d89e-491d-85ca-3937e64e7a19 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:05.722536 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5f7ec-d89e-491d-85ca-3937e64e7a19 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:05.783479 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d4337-5040-4b4a-9195-16561596518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:05.784083 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d4337-5040-4b4a-9195-16561596518e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:05.784461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d4337-5040-4b4a-9195-16561596518e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:05.784736 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d4337-5040-4b4a-9195-16561596518e admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:05.785365 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d4337-5040-4b4a-9195-16561596518e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:05.787298 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d4337-5040-4b4a-9195-16561596518e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:05.811893 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1465/2902] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:47:05 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:47:05.816445 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abdfa9-dcaa-49d1-9ec2-0454f3af065b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:05.827375 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abdfa9-dcaa-49d1-9ec2-0454f3af065b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:05.832772 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036eb8d-3b5e-4881-a583-f559af37e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:05.833370 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036eb8d-3b5e-4881-a583-f559af37e57b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:05.833644 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036eb8d-3b5e-4881-a583-f559af37e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:05.833908 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036eb8d-3b5e-4881-a583-f559af37e57b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:05.834548 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036eb8d-3b5e-4881-a583-f559af37e57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:05.836180 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036eb8d-3b5e-4881-a583-f559af37e57b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:05.846261 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1438/2903] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:47:05.850257 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d4337-5040-4b4a-9195-16561596518e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:05.861338 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d4337-5040-4b4a-9195-16561596518e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:05.866583 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65aaf3-4732-46d3-9e54-dcfe7fd9167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:05.867184 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65aaf3-4732-46d3-9e54-dcfe7fd9167f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:05.867487 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65aaf3-4732-46d3-9e54-dcfe7fd9167f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:05.867754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65aaf3-4732-46d3-9e54-dcfe7fd9167f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:05.868396 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65aaf3-4732-46d3-9e54-dcfe7fd9167f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:05.869975 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65aaf3-4732-46d3-9e54-dcfe7fd9167f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:05.880917 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1466/2904] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:47:05.885177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036eb8d-3b5e-4881-a583-f559af37e57b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:05.895450 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036eb8d-3b5e-4881-a583-f559af37e57b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:05.900533 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89867d-8862-45b3-a896-f2d087197e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:05.901186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89867d-8862-45b3-a896-f2d087197e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:05.901456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89867d-8862-45b3-a896-f2d087197e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:05.901725 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89867d-8862-45b3-a896-f2d087197e83 admin admin] PATH_INFO: `/v3/projects/d1787948773947069af51fc4aed39a3e/users/d7da7bae0ce54ba09f5e164da0b17843/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:05.916084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89867d-8862-45b3-a896-f2d087197e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1787948773947069af51fc4aed39a3e, user_id=d7da7bae0ce54ba09f5e164da0b17843, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:05.918704 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89867d-8862-45b3-a896-f2d087197e83 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:05.933124 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1439/2905] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:47:05 2022] PUT /identity/v3/projects/d1787948773947069af51fc4aed39a3e/users/d7da7bae0ce54ba09f5e164da0b17843/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:05.943458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88276b17-6ad5-44a2-9dd5-76db250b480f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:05.943740 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88276b17-6ad5-44a2-9dd5-76db250b480f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:05.944009 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88276b17-6ad5-44a2-9dd5-76db250b480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:05.974745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-88276b17-6ad5-44a2-9dd5-76db250b480f None None] MFA Rules not processed for user `d7da7bae0ce54ba09f5e164da0b17843`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:05.975925 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-88276b17-6ad5-44a2-9dd5-76db250b480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:06.049654 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1467/2906] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:06.054421 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89867d-8862-45b3-a896-f2d087197e83 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:06.130074 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89867d-8862-45b3-a896-f2d087197e83 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:06.135847 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27e377-ba1c-4b7b-b00a-3054f87dead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:06.136480 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27e377-ba1c-4b7b-b00a-3054f87dead0 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:06.136759 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27e377-ba1c-4b7b-b00a-3054f87dead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:06.137033 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27e377-ba1c-4b7b-b00a-3054f87dead0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:06.137660 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27e377-ba1c-4b7b-b00a-3054f87dead0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:06.139789 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27e377-ba1c-4b7b-b00a-3054f87dead0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:06.173902 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1440/2907] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:47:06 2022] POST /identity/v3/projects => generated 401 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:47:06.178142 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88276b17-6ad5-44a2-9dd5-76db250b480f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:06.189169 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88276b17-6ad5-44a2-9dd5-76db250b480f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:06.215107 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:06.249031 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53a3c-5492-4616-a5bf-ba001b108e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:06.249555 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53a3c-5492-4616-a5bf-ba001b108e8b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:06.249831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53a3c-5492-4616-a5bf-ba001b108e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:06.250096 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53a3c-5492-4616-a5bf-ba001b108e8b admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:06.250738 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53a3c-5492-4616-a5bf-ba001b108e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:06.252759 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53a3c-5492-4616-a5bf-ba001b108e8b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:06.277510 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1468/2908] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:47:06 2022] POST /identity/v3/users => generated 307 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:47:06.279684 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27e377-ba1c-4b7b-b00a-3054f87dead0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:06.290578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27e377-ba1c-4b7b-b00a-3054f87dead0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:06.295875 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d06e10-f412-426b-ad47-70d51361a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:06.296455 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d06e10-f412-426b-ad47-70d51361a9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:06.296728 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d06e10-f412-426b-ad47-70d51361a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:06.296992 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d06e10-f412-426b-ad47-70d51361a9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:06.297674 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d06e10-f412-426b-ad47-70d51361a9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:06.299269 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d06e10-f412-426b-ad47-70d51361a9cf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:06.309980 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1441/2909] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:47:06.314472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53a3c-5492-4616-a5bf-ba001b108e8b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:06.324966 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53a3c-5492-4616-a5bf-ba001b108e8b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:06.330547 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a414b89-d78e-487c-b9c7-ef7d70d5384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:06.331532 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a414b89-d78e-487c-b9c7-ef7d70d5384e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:06.331672 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a414b89-d78e-487c-b9c7-ef7d70d5384e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:06.331949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a414b89-d78e-487c-b9c7-ef7d70d5384e admin admin] PATH_INFO: `/v3/projects/ce6c45737b2b445f9c7f5fc7322900f1/users/68c1ecf18fe4494089cf985969b1e7b9/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:06.352430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a414b89-d78e-487c-b9c7-ef7d70d5384e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6c45737b2b445f9c7f5fc7322900f1, user_id=68c1ecf18fe4494089cf985969b1e7b9, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:06.355200 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a414b89-d78e-487c-b9c7-ef7d70d5384e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:06.369461 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1469/2910] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:47:06 2022] PUT /identity/v3/projects/ce6c45737b2b445f9c7f5fc7322900f1/users/68c1ecf18fe4494089cf985969b1e7b9/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:06.373453 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d06e10-f412-426b-ad47-70d51361a9cf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:06.383703 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d06e10-f412-426b-ad47-70d51361a9cf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:06.441246 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb01cb-cb6e-4ea4-9020-e41d1a4766b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:06.441978 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb01cb-cb6e-4ea4-9020-e41d1a4766b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:06.442257 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb01cb-cb6e-4ea4-9020-e41d1a4766b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:06.442523 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb01cb-cb6e-4ea4-9020-e41d1a4766b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:06.443173 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb01cb-cb6e-4ea4-9020-e41d1a4766b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:06.444845 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb01cb-cb6e-4ea4-9020-e41d1a4766b2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:06.456070 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1442/2911] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:47:06.460328 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a414b89-d78e-487c-b9c7-ef7d70d5384e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:06.471192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a414b89-d78e-487c-b9c7-ef7d70d5384e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:06.476197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4fc59-a686-4f1e-ba41-1be2d64d1e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:06.476831 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4fc59-a686-4f1e-ba41-1be2d64d1e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:06.477108 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4fc59-a686-4f1e-ba41-1be2d64d1e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:06.477413 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4fc59-a686-4f1e-ba41-1be2d64d1e90 admin admin] PATH_INFO: `/v3/projects/ce6c45737b2b445f9c7f5fc7322900f1/users/68c1ecf18fe4494089cf985969b1e7b9/roles/89425e36538543d89d2c3844c8b6dc0a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:06.479343 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4fc59-a686-4f1e-ba41-1be2d64d1e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6c45737b2b445f9c7f5fc7322900f1, user_id=68c1ecf18fe4494089cf985969b1e7b9, role_id=89425e36538543d89d2c3844c8b6dc0a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:06.482035 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4fc59-a686-4f1e-ba41-1be2d64d1e90 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:06.493296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1470/2912] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:47:06 2022] PUT /identity/v3/projects/ce6c45737b2b445f9c7f5fc7322900f1/users/68c1ecf18fe4494089cf985969b1e7b9/roles/89425e36538543d89d2c3844c8b6dc0a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:06.504729 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819ae29-7bef-4713-a059-18fb33b02a8b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:06.504972 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819ae29-7bef-4713-a059-18fb33b02a8b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:06.505244 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819ae29-7bef-4713-a059-18fb33b02a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:06.513752 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:06.534821 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0819ae29-7bef-4713-a059-18fb33b02a8b None None] MFA Rules not processed for user `68c1ecf18fe4494089cf985969b1e7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:06.536041 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0819ae29-7bef-4713-a059-18fb33b02a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:06.603337 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1443/2913] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:47:06.616379 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4fc59-a686-4f1e-ba41-1be2d64d1e90 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:06.618527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-32b4fc59-a686-4f1e-ba41-1be2d64d1e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:06.678749 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4fc59-a686-4f1e-ba41-1be2d64d1e90 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:06.682982 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ada84d-1642-4b7c-99ab-efbe4fddf5a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:06.683613 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ada84d-1642-4b7c-99ab-efbe4fddf5a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:06.683886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ada84d-1642-4b7c-99ab-efbe4fddf5a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:06.684150 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ada84d-1642-4b7c-99ab-efbe4fddf5a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:06.694178 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ada84d-1642-4b7c-99ab-efbe4fddf5a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:06.695665 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ada84d-1642-4b7c-99ab-efbe4fddf5a2 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:06.706430 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1471/2914] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:47:06 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:47:06.790220 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819ae29-7bef-4713-a059-18fb33b02a8b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:06.800810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819ae29-7bef-4713-a059-18fb33b02a8b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:06.804843 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd4788-61e9-4fca-b099-3eca2849cdbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:06.805439 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4788-61e9-4fca-b099-3eca2849cdbf service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:06.805742 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4788-61e9-4fca-b099-3eca2849cdbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:06.806007 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4788-61e9-4fca-b099-3eca2849cdbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:06.870101 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd4788-61e9-4fca-b099-3eca2849cdbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:06.872417 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd4788-61e9-4fca-b099-3eca2849cdbf service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:06.883277 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1444/2915] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:47:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:47:11.014500 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ada84d-1642-4b7c-99ab-efbe4fddf5a2 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:11.083019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ada84d-1642-4b7c-99ab-efbe4fddf5a2 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:11.088063 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:11.088639 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:11.088907 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:11.089188 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] PATH_INFO: `/v3/users/d7da7bae0ce54ba09f5e164da0b17843` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:11.090345 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7da7bae0ce54ba09f5e164da0b17843)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:11.092326 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:11.122935 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:11.145789 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7da7bae0ce54ba09f5e164da0b17843'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.154457 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7da7bae0ce54ba09f5e164da0b17843'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.166366 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7da7bae0ce54ba09f5e164da0b17843'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.166981 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7da7bae0ce54ba09f5e164da0b17843'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.174318 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7da7bae0ce54ba09f5e164da0b17843'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.180868 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1472/2916] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:47:11 2022] DELETE /identity/v3/users/d7da7bae0ce54ba09f5e164da0b17843 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:11.185823 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8875e8-7184-4a64-85b6-fa2d9c5b73f1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:11.186355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8875e8-7184-4a64-85b6-fa2d9c5b73f1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:11.186355 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8875e8-7184-4a64-85b6-fa2d9c5b73f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:11.206561 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5a8875e8-7184-4a64-85b6-fa2d9c5b73f1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:11.207805 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5a8875e8-7184-4a64-85b6-fa2d9c5b73f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:11.269654 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1445/2917] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 04:47:11.281561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:11.283659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:11.344378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b71e20-2021-434a-9fa2-c5de3412d37b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:11.348561 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a35df-ba26-4239-a0d0-59f246a42260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:11.349204 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a35df-ba26-4239-a0d0-59f246a42260 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:11.349477 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a35df-ba26-4239-a0d0-59f246a42260 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:11.349739 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a35df-ba26-4239-a0d0-59f246a42260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:11.359745 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a35df-ba26-4239-a0d0-59f246a42260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:11.361159 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a35df-ba26-4239-a0d0-59f246a42260 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:11.370620 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1473/2918] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:47:11.654451 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8875e8-7184-4a64-85b6-fa2d9c5b73f1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:11.655927 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5a8875e8-7184-4a64-85b6-fa2d9c5b73f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:11.668765 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8875e8-7184-4a64-85b6-fa2d9c5b73f1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:11.673707 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:11.674425 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:11.674714 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:11.674987 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] PATH_INFO: `/v3/projects/d1787948773947069af51fc4aed39a3e` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:11.676186 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1787948773947069af51fc4aed39a3e)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:11.678126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:11.703574 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:11.729016 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1787948773947069af51fc4aed39a3e', 'request_id': 'req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.738361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1787948773947069af51fc4aed39a3e', 'request_id': 'req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.743768 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1787948773947069af51fc4aed39a3e', 'request_id': 'req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.754916 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] The token cache is being invalidate because project d1787948773947069af51fc4aed39a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:47:11.755198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.755945 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.757545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1446/2919] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:47:11 2022] DELETE /identity/v3/projects/d1787948773947069af51fc4aed39a3e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:11.761673 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a35df-ba26-4239-a0d0-59f246a42260 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:11.771945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a35df-ba26-4239-a0d0-59f246a42260 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:11.832130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:11.832754 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:11.833023 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:11.833296 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] PATH_INFO: `/v3/users/68c1ecf18fe4494089cf985969b1e7b9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:11.834412 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c1ecf18fe4494089cf985969b1e7b9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:11.836378 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:11.883124 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c1ecf18fe4494089cf985969b1e7b9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.884724 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:11.893192 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c1ecf18fe4494089cf985969b1e7b9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.906472 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c1ecf18fe4494089cf985969b1e7b9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.907100 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c1ecf18fe4494089cf985969b1e7b9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.913886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ecb216b9-457a-46c0-8ff2-bf3c3856a8ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c1ecf18fe4494089cf985969b1e7b9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:11.919659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1474/2920] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:47:11 2022] DELETE /identity/v3/users/68c1ecf18fe4494089cf985969b1e7b9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:12.187479 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:12.189080 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:12.203499 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ad39d-7bab-492e-a348-ab409ad2ffd8 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:12.271454 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:12.272084 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:12.272368 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:12.272622 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] PATH_INFO: `/v3/projects/ce6c45737b2b445f9c7f5fc7322900f1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:12.273723 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6c45737b2b445f9c7f5fc7322900f1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:12.275664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:12.326497 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6c45737b2b445f9c7f5fc7322900f1', 'request_id': 'req-22bd5a01-2698-41af-8c1a-541890904f74'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:12.335810 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6c45737b2b445f9c7f5fc7322900f1', 'request_id': 'req-22bd5a01-2698-41af-8c1a-541890904f74'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:12.342028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6c45737b2b445f9c7f5fc7322900f1', 'request_id': 'req-22bd5a01-2698-41af-8c1a-541890904f74'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:12.353938 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] The token cache is being invalidate because project ce6c45737b2b445f9c7f5fc7322900f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:47:12.354225 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:12.354881 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22bd5a01-2698-41af-8c1a-541890904f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:12.356751 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1447/2921] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:47:12 2022] DELETE /identity/v3/projects/ce6c45737b2b445f9c7f5fc7322900f1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:12.362065 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbba063-e44d-4178-b2a6-a6aa7e7d6c9d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:12.362538 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbba063-e44d-4178-b2a6-a6aa7e7d6c9d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:12.362640 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbba063-e44d-4178-b2a6-a6aa7e7d6c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:12.383591 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6dbba063-e44d-4178-b2a6-a6aa7e7d6c9d None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:12.384798 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6dbba063-e44d-4178-b2a6-a6aa7e7d6c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:12.447680 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1475/2922] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:12.458951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c5ac-00dd-4bf0-b5cd-25cfb0779360 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:12.459331 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c5ac-00dd-4bf0-b5cd-25cfb0779360 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:12.459693 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c5ac-00dd-4bf0-b5cd-25cfb0779360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:12.488844 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cf01c5ac-00dd-4bf0-b5cd-25cfb0779360 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:12.490067 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cf01c5ac-00dd-4bf0-b5cd-25cfb0779360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:12.499013 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1448/2923] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:12.503804 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbba063-e44d-4178-b2a6-a6aa7e7d6c9d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:12.514127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbba063-e44d-4178-b2a6-a6aa7e7d6c9d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:12.519800 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b20ee-9235-41b4-be7c-f337fe5bc97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:12.520411 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b20ee-9235-41b4-be7c-f337fe5bc97a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:12.520691 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b20ee-9235-41b4-be7c-f337fe5bc97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:12.520963 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b20ee-9235-41b4-be7c-f337fe5bc97a admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:12.521617 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b20ee-9235-41b4-be7c-f337fe5bc97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:47:12.521923 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b20ee-9235-41b4-be7c-f337fe5bc97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:12.523560 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b20ee-9235-41b4-be7c-f337fe5bc97a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:12.535814 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1476/2924] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:47:12.540202 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01c5ac-00dd-4bf0-b5cd-25cfb0779360 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:12.550055 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01c5ac-00dd-4bf0-b5cd-25cfb0779360 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:12.555940 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0510c4c-5435-4f43-8cba-9841338295bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:12.556547 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510c4c-5435-4f43-8cba-9841338295bc admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:12.556826 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510c4c-5435-4f43-8cba-9841338295bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:12.557082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510c4c-5435-4f43-8cba-9841338295bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:12.557717 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0510c4c-5435-4f43-8cba-9841338295bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:12.559647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0510c4c-5435-4f43-8cba-9841338295bc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:12.589618 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1449/2925] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:47:12 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:47:12.594019 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b20ee-9235-41b4-be7c-f337fe5bc97a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:12.605569 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b20ee-9235-41b4-be7c-f337fe5bc97a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:12.665438 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1706dc5-b332-41b6-ad14-e93c7b973f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:12.666046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1706dc5-b332-41b6-ad14-e93c7b973f73 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:12.666322 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1706dc5-b332-41b6-ad14-e93c7b973f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:12.666593 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1706dc5-b332-41b6-ad14-e93c7b973f73 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:12.667226 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1706dc5-b332-41b6-ad14-e93c7b973f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:12.669172 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1706dc5-b332-41b6-ad14-e93c7b973f73 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:12.691092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1477/2926] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:47:12 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 04:47:12.695380 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0510c4c-5435-4f43-8cba-9841338295bc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:12.706502 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0510c4c-5435-4f43-8cba-9841338295bc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:12.711802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736427f-dd9e-418f-90cc-57c31bdaf4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:12.712408 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736427f-dd9e-418f-90cc-57c31bdaf4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:12.712702 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736427f-dd9e-418f-90cc-57c31bdaf4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:12.712956 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736427f-dd9e-418f-90cc-57c31bdaf4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:12.713724 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736427f-dd9e-418f-90cc-57c31bdaf4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:12.715361 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736427f-dd9e-418f-90cc-57c31bdaf4d2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:12.725884 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1450/2927] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:47:12.729971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1706dc5-b332-41b6-ad14-e93c7b973f73 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:12.740861 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1706dc5-b332-41b6-ad14-e93c7b973f73 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:12.745989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d814d6-6e85-432c-8f2c-308b7b834afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:12.746592 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d814d6-6e85-432c-8f2c-308b7b834afc admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:12.746861 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d814d6-6e85-432c-8f2c-308b7b834afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:12.747127 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d814d6-6e85-432c-8f2c-308b7b834afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:12.747788 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d814d6-6e85-432c-8f2c-308b7b834afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:12.749373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d814d6-6e85-432c-8f2c-308b7b834afc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:12.760146 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1478/2928] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:47:12.764398 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736427f-dd9e-418f-90cc-57c31bdaf4d2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:12.769984 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:12.776274 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736427f-dd9e-418f-90cc-57c31bdaf4d2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:12.782485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfba8-7684-469e-b78d-53a7be120db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:12.783371 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfba8-7684-469e-b78d-53a7be120db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:12.783646 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfba8-7684-469e-b78d-53a7be120db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:12.783913 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfba8-7684-469e-b78d-53a7be120db2 admin admin] PATH_INFO: `/v3/projects/6916c4022f09433892c8c2a313610059/users/362433b58f7f4120b14b8941fbbbaca7/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:12.799418 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dfba8-7684-469e-b78d-53a7be120db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6916c4022f09433892c8c2a313610059, user_id=362433b58f7f4120b14b8941fbbbaca7, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:12.802093 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dfba8-7684-469e-b78d-53a7be120db2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:12.818237 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1451/2929] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:47:12 2022] PUT /identity/v3/projects/6916c4022f09433892c8c2a313610059/users/362433b58f7f4120b14b8941fbbbaca7/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:12.828867 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6637a-7bfa-4d54-b28f-1e31d58160c1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:12.829149 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6637a-7bfa-4d54-b28f-1e31d58160c1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:12.829441 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6637a-7bfa-4d54-b28f-1e31d58160c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:12.859903 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d1d6637a-7bfa-4d54-b28f-1e31d58160c1 None None] MFA Rules not processed for user `362433b58f7f4120b14b8941fbbbaca7`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:12.861216 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d1d6637a-7bfa-4d54-b28f-1e31d58160c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:12.880543 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:12.931703 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1479/2930] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:12.943035 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfba8-7684-469e-b78d-53a7be120db2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:12.945082 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fd0dfba8-7684-469e-b78d-53a7be120db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:13.005289 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfba8-7684-469e-b78d-53a7be120db2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:13.009471 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa414df5-2df9-4258-9da3-4b63291c8160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66a78c94f03443cbae595bba07e458d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:13.010097 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa414df5-2df9-4258-9da3-4b63291c8160 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:13.010373 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa414df5-2df9-4258-9da3-4b63291c8160 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:13.010634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa414df5-2df9-4258-9da3-4b63291c8160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:13.020456 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa414df5-2df9-4258-9da3-4b63291c8160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:13.021867 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa414df5-2df9-4258-9da3-4b63291c8160 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:13.031137 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1452/2931] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:47:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:47:16.156303 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6637a-7bfa-4d54-b28f-1e31d58160c1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:16.224935 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6637a-7bfa-4d54-b28f-1e31d58160c1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:16.229912 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:16.230546 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:16.230820 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:16.231089 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] PATH_INFO: `/v3/users/362433b58f7f4120b14b8941fbbbaca7` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:16.232245 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=362433b58f7f4120b14b8941fbbbaca7)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:16.234527 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:16.301219 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362433b58f7f4120b14b8941fbbbaca7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:16.312194 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362433b58f7f4120b14b8941fbbbaca7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:16.326061 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362433b58f7f4120b14b8941fbbbaca7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:16.326859 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362433b58f7f4120b14b8941fbbbaca7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:16.334709 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362433b58f7f4120b14b8941fbbbaca7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:16.341193 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1480/2932] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:47:16 2022] DELETE /identity/v3/users/362433b58f7f4120b14b8941fbbbaca7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:16.346026 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcc4c8-8801-4ae1-a729-b2edc8dfb989 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:16.346570 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcc4c8-8801-4ae1-a729-b2edc8dfb989 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:16.346570 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcc4c8-8801-4ae1-a729-b2edc8dfb989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:16.366545 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d5bcc4c8-8801-4ae1-a729-b2edc8dfb989 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:16.367793 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d5bcc4c8-8801-4ae1-a729-b2edc8dfb989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:16.428816 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1453/2933] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:16.438956 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:16.440659 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:16.488751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:16.506305 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e41aae-29d2-4fcb-ba8d-547256e3b23b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:16.510026 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26e3d-39cc-40f9-94ce-58ac3a636ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:16.510637 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26e3d-39cc-40f9-94ce-58ac3a636ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:16.510908 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26e3d-39cc-40f9-94ce-58ac3a636ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:16.511173 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26e3d-39cc-40f9-94ce-58ac3a636ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:16.520190 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b26e3d-39cc-40f9-94ce-58ac3a636ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:16.521601 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b26e3d-39cc-40f9-94ce-58ac3a636ab3 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:16.531266 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1481/2934] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:47:16.811552 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcc4c8-8801-4ae1-a729-b2edc8dfb989 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:16.813092 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d5bcc4c8-8801-4ae1-a729-b2edc8dfb989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:16.827245 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcc4c8-8801-4ae1-a729-b2edc8dfb989 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:16.834011 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:16.834671 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:16.834917 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:16.835266 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] PATH_INFO: `/v3/projects/6916c4022f09433892c8c2a313610059` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:16.836539 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6916c4022f09433892c8c2a313610059)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:16.838951 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:16.888396 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6916c4022f09433892c8c2a313610059', 'request_id': 'req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:16.896327 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6916c4022f09433892c8c2a313610059', 'request_id': 'req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:16.902147 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6916c4022f09433892c8c2a313610059', 'request_id': 'req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:16.913198 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] The token cache is being invalidate because project 6916c4022f09433892c8c2a313610059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:47:16.913478 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:16.914143 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a093e1c7-3e9d-481e-aa53-a8cf3846a06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:16.915736 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1454/2935] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:47:16 2022] DELETE /identity/v3/projects/6916c4022f09433892c8c2a313610059 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:16.920941 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2028eb-fa45-4bef-a259-e40b1bf6cce2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:16.921225 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2028eb-fa45-4bef-a259-e40b1bf6cce2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:16.921523 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2028eb-fa45-4bef-a259-e40b1bf6cce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:16.942210 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ea2028eb-fa45-4bef-a259-e40b1bf6cce2 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:16.943470 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ea2028eb-fa45-4bef-a259-e40b1bf6cce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:17.015111 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1482/2936] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:17.024635 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d86c3d-62d1-496a-a5b4-cd68d9c98936 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:17.024910 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d86c3d-62d1-496a-a5b4-cd68d9c98936 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:17.025177 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d86c3d-62d1-496a-a5b4-cd68d9c98936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:17.034081 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:17.046892 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-71d86c3d-62d1-496a-a5b4-cd68d9c98936 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:17.048588 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-71d86c3d-62d1-496a-a5b4-cd68d9c98936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:17.056943 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1455/2937] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:17.061428 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2028eb-fa45-4bef-a259-e40b1bf6cce2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:17.071627 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2028eb-fa45-4bef-a259-e40b1bf6cce2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:17.076694 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9cc86-bdb3-423e-8c0c-30ec16430ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:17.077307 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9cc86-bdb3-423e-8c0c-30ec16430ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:17.077599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9cc86-bdb3-423e-8c0c-30ec16430ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:17.077849 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9cc86-bdb3-423e-8c0c-30ec16430ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:17.078480 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9cc86-bdb3-423e-8c0c-30ec16430ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 04:47:17.078776 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9cc86-bdb3-423e-8c0c-30ec16430ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:17.080406 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9cc86-bdb3-423e-8c0c-30ec16430ce2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:17.092197 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1483/2938] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Oct 6 04:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 04:47:17.096566 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d86c3d-62d1-496a-a5b4-cd68d9c98936 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:17.106028 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d86c3d-62d1-496a-a5b4-cd68d9c98936 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:17.111334 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05e8e4-04e4-4e7e-a971-8111e2dcdda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:17.111942 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e8e4-04e4-4e7e-a971-8111e2dcdda2 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:17.112210 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e8e4-04e4-4e7e-a971-8111e2dcdda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:17.112476 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e8e4-04e4-4e7e-a971-8111e2dcdda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:17.113100 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05e8e4-04e4-4e7e-a971-8111e2dcdda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:17.115174 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05e8e4-04e4-4e7e-a971-8111e2dcdda2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:17.150185 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1456/2939] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Oct 6 04:47:17 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:47:17.155078 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9cc86-bdb3-423e-8c0c-30ec16430ce2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:17.167989 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9cc86-bdb3-423e-8c0c-30ec16430ce2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:17.226833 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd126-e59a-4c29-a343-0ac3d4884e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:17.227384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd126-e59a-4c29-a343-0ac3d4884e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:17.227663 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd126-e59a-4c29-a343-0ac3d4884e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:17.227949 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd126-e59a-4c29-a343-0ac3d4884e07 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:17.228575 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcd126-e59a-4c29-a343-0ac3d4884e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:17.230489 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcd126-e59a-4c29-a343-0ac3d4884e07 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:17.256003 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1484/2940] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Oct 6 04:47:17 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 04:47:17.259664 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05e8e4-04e4-4e7e-a971-8111e2dcdda2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:17.269957 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05e8e4-04e4-4e7e-a971-8111e2dcdda2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:17.275485 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b86f66-1de4-47aa-8d5b-f27946ca772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:17.276087 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b86f66-1de4-47aa-8d5b-f27946ca772d admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:17.276365 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b86f66-1de4-47aa-8d5b-f27946ca772d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:17.276634 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b86f66-1de4-47aa-8d5b-f27946ca772d admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:17.277282 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b86f66-1de4-47aa-8d5b-f27946ca772d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:17.278887 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b86f66-1de4-47aa-8d5b-f27946ca772d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:17.289259 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1457/2941] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:47:17.293130 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd126-e59a-4c29-a343-0ac3d4884e07 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:17.302945 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd126-e59a-4c29-a343-0ac3d4884e07 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:17.308458 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87264e38-5167-4fca-a86a-305f74948106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:17.309092 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87264e38-5167-4fca-a86a-305f74948106 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:17.309370 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87264e38-5167-4fca-a86a-305f74948106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:17.309638 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87264e38-5167-4fca-a86a-305f74948106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:17.310283 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87264e38-5167-4fca-a86a-305f74948106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:17.311998 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87264e38-5167-4fca-a86a-305f74948106 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:17.323719 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1485/2942] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 6 04:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 04:47:17.328160 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b86f66-1de4-47aa-8d5b-f27946ca772d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:17.338835 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b86f66-1de4-47aa-8d5b-f27946ca772d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:17.344748 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ef072-d0c0-4ce5-a286-7aa552933617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:17.345433 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ef072-d0c0-4ce5-a286-7aa552933617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:17.345707 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ef072-d0c0-4ce5-a286-7aa552933617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:17.345974 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ef072-d0c0-4ce5-a286-7aa552933617 admin admin] PATH_INFO: `/v3/projects/12bf9045d4e64bcc9d0b2e16060580c5/users/10c17e58a28d43758e6271a55d314511/roles/ec48f4c280dd43db99923e3badf5fe36` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:17.362105 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ef072-d0c0-4ce5-a286-7aa552933617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12bf9045d4e64bcc9d0b2e16060580c5, user_id=10c17e58a28d43758e6271a55d314511, role_id=ec48f4c280dd43db99923e3badf5fe36)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:17.365126 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ef072-d0c0-4ce5-a286-7aa552933617 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:17.379395 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1458/2943] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Oct 6 04:47:17 2022] PUT /identity/v3/projects/12bf9045d4e64bcc9d0b2e16060580c5/users/10c17e58a28d43758e6271a55d314511/roles/ec48f4c280dd43db99923e3badf5fe36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:17.395689 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cee45d-6eb3-491b-a6ba-bf8b759dc412 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:17.396046 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cee45d-6eb3-491b-a6ba-bf8b759dc412 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:17.396371 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cee45d-6eb3-491b-a6ba-bf8b759dc412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:17.429599 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-54cee45d-6eb3-491b-a6ba-bf8b759dc412 None None] MFA Rules not processed for user `10c17e58a28d43758e6271a55d314511`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:17.430835 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-54cee45d-6eb3-491b-a6ba-bf8b759dc412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:17.470359 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:17.498515 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1486/2944] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:17.511602 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ef072-d0c0-4ce5-a286-7aa552933617 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:17.513578 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-861ef072-d0c0-4ce5-a286-7aa552933617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:17.594802 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ef072-d0c0-4ce5-a286-7aa552933617 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:17.598775 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe45551-9547-4664-8de7-89fd5d8cc8fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '457880195ed849d2b594ddea6acdf7df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:17.599428 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe45551-9547-4664-8de7-89fd5d8cc8fb service glance] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:17.599698 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe45551-9547-4664-8de7-89fd5d8cc8fb service glance] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:17.599962 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe45551-9547-4664-8de7-89fd5d8cc8fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:17.609589 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe45551-9547-4664-8de7-89fd5d8cc8fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:17.611003 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe45551-9547-4664-8de7-89fd5d8cc8fb service glance] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:17.621219 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1459/2945] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:47:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:47:27.495297 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=10 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:27.616647 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=60,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:46.050985 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cee45d-6eb3-491b-a6ba-bf8b759dc412 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:46.115464 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cee45d-6eb3-491b-a6ba-bf8b759dc412 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:46.120384 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:46.121012 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:46.121533 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:46.121809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] PATH_INFO: `/v3/users/10c17e58a28d43758e6271a55d314511` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:46.122971 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c17e58a28d43758e6271a55d314511)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:46.124920 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:46.174810 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c17e58a28d43758e6271a55d314511'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:46.184006 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c17e58a28d43758e6271a55d314511'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:46.198373 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c17e58a28d43758e6271a55d314511'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:46.199058 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c17e58a28d43758e6271a55d314511'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:46.206395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c17e58a28d43758e6271a55d314511'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:46.213164 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1487/2946] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 6 04:47:46 2022] DELETE /identity/v3/users/10c17e58a28d43758e6271a55d314511 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:46.217924 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe46ba-9c9c-4502-923c-fae01f31d5e1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:46.218423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe46ba-9c9c-4502-923c-fae01f31d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:46.218423 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe46ba-9c9c-4502-923c-fae01f31d5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:46.239353 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f7fe46ba-9c9c-4502-923c-fae01f31d5e1 None None] MFA Rules not processed for user `a648d0c15aec4e95a5b091741686db89`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 04:47:46.240807 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f7fe46ba-9c9c-4502-923c-fae01f31d5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:46.303627 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1460/2947] 10.222.0.20 () {58 vars in 958 bytes} [Thu Oct 6 04:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 04:47:46.313728 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:46.315293 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:46.382330 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09cbb5-089c-4013-9632-61fb00d9947f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:46.386284 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae9172-2b7d-435e-920d-3d8a5f9a2181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ca0a824c4740dbb911bb1a38cfc47b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:46.386886 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae9172-2b7d-435e-920d-3d8a5f9a2181 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:46.387162 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae9172-2b7d-435e-920d-3d8a5f9a2181 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:46.387460 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae9172-2b7d-435e-920d-3d8a5f9a2181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:46.396565 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae9172-2b7d-435e-920d-3d8a5f9a2181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:46.398043 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae9172-2b7d-435e-920d-3d8a5f9a2181 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:46.408148 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1488/2948] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:47:46.697593 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe46ba-9c9c-4502-923c-fae01f31d5e1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:47:46.699113 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f7fe46ba-9c9c-4502-923c-fae01f31d5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:47:46.712643 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe46ba-9c9c-4502-923c-fae01f31d5e1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:47:46.717434 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a648d0c15aec4e95a5b091741686db89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fb2ccd61eb54f9ca99cf78861f2f327', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:47:46.718830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:47:46.718830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:47:46.718830 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] PATH_INFO: `/v3/projects/12bf9045d4e64bcc9d0b2e16060580c5` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:47:46.720165 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=12bf9045d4e64bcc9d0b2e16060580c5)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:47:46.727757 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:47:46.776411 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12bf9045d4e64bcc9d0b2e16060580c5', 'request_id': 'req-f220e345-b1c0-4219-b75c-b37c546ee4bd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:46.784785 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12bf9045d4e64bcc9d0b2e16060580c5', 'request_id': 'req-f220e345-b1c0-4219-b75c-b37c546ee4bd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:46.792481 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12bf9045d4e64bcc9d0b2e16060580c5', 'request_id': 'req-f220e345-b1c0-4219-b75c-b37c546ee4bd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:46.810431 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] The token cache is being invalidate because project 12bf9045d4e64bcc9d0b2e16060580c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 04:47:46.810677 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:46.811766 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f220e345-b1c0-4219-b75c-b37c546ee4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 04:47:46.814187 dv-cinder-860227-2-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1461/2949] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 6 04:47:46 2022] DELETE /identity/v3/projects/12bf9045d4e64bcc9d0b2e16060580c5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 04:47:56.403490 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:56.805296 dv-cinder-860227-2-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:51:44.309351 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae9172-2b7d-435e-920d-3d8a5f9a2181 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 04:51:44.310960 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8eae9172-2b7d-435e-920d-3d8a5f9a2181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:51:44.460041 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae9172-2b7d-435e-920d-3d8a5f9a2181 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 04:51:44.525503 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c546ee9-4fba-4d84-9233-030f432fadf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4e48fdc18e424fa2cf80fd5da332b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6bea894013f40638404395075ade90d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 04:51:44.526117 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c546ee9-4fba-4d84-9233-030f432fadf6 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 04:51:44.526395 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c546ee9-4fba-4d84-9233-030f432fadf6 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 04:51:44.526664 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c546ee9-4fba-4d84-9233-030f432fadf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 04:51:44.528751 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1c546ee9-4fba-4d84-9233-030f432fadf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 04:51:44.540809 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c546ee9-4fba-4d84-9233-030f432fadf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 04:51:44.542496 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c546ee9-4fba-4d84-9233-030f432fadf6 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 04:51:44.552730 dv-cinder-860227-2-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1489/2950] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Oct 6 04:51:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 04:51:54.548678 dv-cinder-860227-2-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}